CN117746762A - Display processing method, device and electronic equipment - Google Patents

Abstract

This application discloses a display processing method, device and electronic equipment. When the electronic device exits the standby idle state, the first duration T1 is determined. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The end point t2 of T1 is the earliest time the display driver can modify the blanking zone porch in the second frame. The timestamp corresponding to the time; determine T2 according to T1; T1=n*T+T2, T=1/f1; when T2<V1, perform the operation of modifying the porch at time t4; V1 is when the modification of the porch and hardware interface are satisfied When the DSI response to the cmd command is completed within the second frame, modify the duration corresponding to the latest time t3 of the porch and the timestamp corresponding to the Vsync signal of the second frame; t2 ≤ t4 ≤ t3. Based on the solution of this application, the electronic device can avoid screen blur when exiting the standby state and the frame rate of the image to be displayed changes.

Description

Display processing method, device and electronic equipment

Technical field

The present application relates to the technical field of video playback, and more specifically, to a display processing method, device and electronic equipment.

Background technique

Fragmentation refers to the phenomenon of irregular stripes, snowflakes or other abnormal images appearing on the monitor screen. When the electronic device exits the idle state and the frequency of the image to be displayed is different from the frequency in the standby state, the display screen of the electronic device may sometimes appear blurred, affecting the display effect.

Therefore, how to avoid screen blur is an issue that needs to be solved urgently.

Contents of the invention

This application provides a display processing method, device and electronic equipment, which can avoid screen blur when the electronic equipment exits the standby state and the display rate changes.

In a first aspect, a display processing method is provided, which is applied to an electronic device. The display screen of the electronic device is in an idle state at a first frame rate f1. The method includes: exiting the idle state when there is an image update, The frame rate corresponding to the updated image is the second frame rate f2, and f2≠f1; determine the first duration T1, and the starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame, and the The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the timestamp corresponding to the earliest moment in the second frame when the display driver can modify the blanking area porch, and the second frame is the The frame in which the electronic device exits the idle state; determine T2 according to the T1; wherein, the T1=n*T+T2, the T=1/f1, the n is an integer, n≥0, 0< T2<T; when T2<V1, the operation of modifying the porch is performed at time t4; the V1 is modified when the modification of the porch and the hardware interface DSI response cmd command are both completed in the second frame. The duration corresponding to the latest time t3 of the porch and the timestamp corresponding to the Vsync signal of the second frame; where, t2≤t4≤t3.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame. This can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes.

In another possible implementation, the method further includes: when T2 < V1, causing the display screen to display an image with f2 in the next frame of the second frame.

In another possible implementation, when T2 ≥ V1, the operation of modifying the porch is performed at time t6, where t6 is within the third frame, and the third frame is the phase of the second frame. In the next adjacent frame, the timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T-V1); t6=t5+T3, the T _VSYNC + T _VBP <T3 <V1, the T _VSYNC is the duration of the Vsync signal of the third frame, and T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame.

In another possible implementation, the method further includes: when T2≥V1, causing the display screen to display an image with f2 in the next frame of the third frame.

In another possible implementation, determining T2 based on T1 includes: determining that the greatest common divisor between f1 and 1000 is x, y=1000/x; determining T2=(b%(y*1000 )%T, where T1 = a (second) + b (microsecond); in the step after determining T2 based on T1, the value of T2 uses the value of T2 determined in this step.

In a second aspect, a display processing device is provided, which is applied to an electronic device. The display screen of the electronic device is in a standby idle state at a first frame rate f1. The device includes: a first processing unit, configured to perform processing when there is an image. When updating, exit the idle state, the frame rate corresponding to the updated image is the second frame rate f2, and f2≠f1; the first determination unit is used to determine the first duration T1, and the starting point t1 of T1 is the second frame rate f2. The timestamp corresponding to the vertical synchronization Vsync signal of one frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the earliest time the display driver can modify the blanking area porch in the second frame. The timestamp corresponding to the moment, the second frame is the frame when the electronic device exits the idle state; the second determination unit is used to determine T2 according to the T1; wherein, theoretically, the T1=n*T +T2, the T=1/f1, the n is an integer, n≥0, 0<T2<T; the modification unit is used to perform the operation of modifying the porch at the t4 moment when the T2<V1 ; The V1 is the duration corresponding to the latest time t3 of modifying the porch and the timestamp corresponding to the Vsync signal of the second frame when both the modification of the porch and the hardware interface DSI response cmd command are completed in the second frame. ; Among them, t2≤t4≤t3.

In another possible implementation, the device further includes: a first display unit configured to display an image with f2 in the next frame of the second frame when T2 <V1.

In another possible implementation, the modification unit is further configured to, when T2≥V1, perform the operation of modifying the porch at time t6, where t6 is within the third frame, and the third The frame is the next frame adjacent to the second frame, and the timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T-V1); t6=t5+T3, and T _VSYNC +T _VBP < T3 < V1, the T _VSYNC is the duration of the Vsync signal of the third frame, and the T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame.

In another possible implementation, the device further includes: a second display unit configured to display the image in f2 in the next frame of the third frame when T2≥V1.

In another possible implementation, in determining T2 based on T1, the second determination unit is specifically configured to determine that the greatest common divisor of f1 and 1000 is x, y=1000/x; determine T2 =(b%(y*1000)%T, where T1=a(second)+b(microsecond); the value of T2 in the modification unit uses the value of T2 determined in this step.

In a third aspect, an electronic device is provided. The electronic device includes a processor, a display and a memory. The memory is used to store a computer program. The display is used to display images. The processor is used to retrieve images from the memory. The computer program is called and run, so that the processor executes the display processing method described in the first aspect or any possible implementation of the first aspect.

In a fourth aspect, a chip is provided, including a processor. When the processor executes instructions, the processor executes the display processing method as described in the above first aspect or any possible implementation of the first aspect. .

In a fifth aspect, a computer-readable storage medium is provided. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, it causes the processor to execute the above-mentioned first aspect or the method of the first aspect. Any possible implementation of the display processing method.

In the embodiment of the present application, when the electronic device is performing display processing, the display screen of the electronic device is in the standby idle state at the first frame rate f1. When there is an image update, the idle state is exited, and the frame rate corresponding to the updated image becomes is f2, f2≠f1; then, determine the first duration T1. The starting point of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point of T1 t2 is the timestamp corresponding to the earliest moment in the second frame when the display driver can modify the blanking zone porch. The second frame is the frame when the electronic device exits the idle state; T2 is determined based on T1; T1=n*T+T2, T =1/f1, n is an integer, n≥0, 0＜T2＜T; when T2＜V1, the operation of modifying the porch is performed at time t4; V1 is when the modification of the porch and the hardware interface DSI response cmd command are both in the first When completed within two frames, modify the duration corresponding to the latest time t3 of the porch and the timestamp corresponding to the Vsync signal of the second frame; t2 ≤ t4 ≤ t3, V3 ≤ V2. When using this solution, since the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame, this can prevent the electronic device from being blurred when it exits the standby state and the frame rate of the image to be displayed changes.

Description of drawings

Figure 1 is a schematic diagram of a blurred screen in an electronic device in the prior art;

Figure 2A is a schematic diagram of the corresponding durations of the rear shoulder of the blanking area, the effective area, and the front shoulder of the blanking area in the vertical direction of each frame of image;

Figure 2B is a schematic diagram of the Video screen processing flow;

Figure 3A is a schematic flowchart of a display processing method provided by an embodiment of the present application;

Figure 3B is a schematic flowchart of a display processing method provided by another embodiment of the present application;

Figure 4A is a schematic flowchart of a display processing method provided by another embodiment of the present application;

Figure 4B is a schematic flowchart of a display processing method provided by another embodiment of the present application;

Figure 5A is a timing diagram including relevant time nodes corresponding to the display processing method provided by an embodiment of the present application;

Figure 5B is a timing diagram including relevant time nodes corresponding to the display processing method provided by an embodiment of the present application;

Figure 5C is a timing diagram including relevant time nodes corresponding to the display processing method provided by an embodiment of the present application;

Figure 5D is a timing diagram including relevant time nodes corresponding to the display processing method provided by an embodiment of the present application;

Figure 6 is a schematic structural diagram of an electronic device that executes a display processing method provided by an embodiment of the present application;

FIG. 7 is a schematic diagram of a software system of an electronic device that executes the display processing method provided by an embodiment of the present application.

Detailed ways

The technical solutions in the embodiments of the present application will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts fall within the scope of protection of this application.

First, the application scenarios of the display processing method provided by the embodiments of the present application are introduced with reference to the accompanying drawings.

The display processing method provided by the embodiment of the present application can be applied to electronic devices with video screens such as mobile phones. In the embodiment of the present application, the electronic device is described using a mobile phone as an example. It can be understood that the electronic device that performs the display processing method provided by the present application It is not limited to mobile phones, but can also be other terminals with video screens. The specific type of electronic equipment is not limited here.

When the phone has not been operated for a preset period of time, the phone enters standby mode to save power. In the standby state, if a preset idle exit event is detected, such as the user sliding the mobile phone display, the electronic device will exit the standby state. When exiting the idle state, the phone will occasionally have a brief screen blur phenomenon. When the screen blur occurs, the display area of the phone will display The image is shown in Figure 1.

As shown in Figure 2A, the synchronization signal in the vertical direction of each frame of image is Vsync, with a period of T. The corresponding durations of the back shoulder of the blanking area, the effective area, and the front shoulder of the blanking area are T _VBP , T _DE , and T respectively. _VFP .

As shown in Figure 2B, the process of displaying images on a mobile phone usually includes the following steps: the application (Application, APP) obtains the content to be displayed, the Surfaceflinger service synthesizes the content to be displayed into the page to be displayed, and the hardware hybrid renderer (Hardware Composer, HWC) ) Converts the format of the page with display, and sends the output to the display driver. The display driver does some underlying encoding, decoding, compression and other operations to load the image and save it into its buffer, and then through the display serial interface (dsi) )'s Mobile Industry Processor Interface (mipi) is sent to the display driver chip (Display Driver IC, DDIC). Vsync is the frame synchronization signal of each frame. After displaying the image numbered 1, the image numbered 2 is displayed. After displaying the image numbered 2, if the mobile phone is in standby state, the upper layer will no longer transmit new images, dsi The hardware continues to transmit the image identified as 2 stored in the cache to the DDIC. After the standby state ends, the upper layer continues to receive new images, transmit and display them.

It should be noted that when the frame rate of the image displayed on the video screen changes, the display of the video screen changes accordingly. The specific implementation includes two methods, one is high switching and the other is real switching. In order to reduce power consumption, this application uses real switching. When switching the frame rate, it is necessary to complete the modification of the porch and send cmd commands. .

FIG. 3A is a schematic flowchart of a display processing method provided by an embodiment of the present application. As shown in Figure 3A, the display processing method provided by the embodiment of the present application includes steps: 301 to 304. Next, steps 301 to 304 are introduced in detail. This embodiment is applied to electronic equipment. The display screen of the electronic equipment is in the standby idle state at the first frame rate f1. The method includes:

301. When there is an image update, exit the idle state. The frame rate corresponding to the updated image is the second frame rate f2, and f2≠f1.

302. Determine the first duration T1. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the time displayed in the second frame. The earliest timestamp corresponding to the time when the driver can modify the blanking zone porch, and the second frame is the frame when the electronic device exits the idle state.

303. Determine T2 based on T1; where, T1=n*T+T2, T=1/f1, n is an integer, n≥0, 0<T2<T.

Since the computer uses floating point calculations, it is impossible to be accurate to an infinite number of digits. Therefore, in actual calculations, T1=n*T+T2 is a theoretical value. When T is an infinite loop number or an infinite non-loop number, the value of n exceeds The larger the cumulative error, the greater the error. In order to reduce the error, the following method can be used to determine T2. Determine the greatest common divisor between f1 and 1000 as x, y=1000/x; determine T2=(b%(y*1000)%T, where T1=a (second)+b (microsecond); determine based on T1 The value of T2 in the step after T2 uses the value of T2 determined in that step.

304. When T2 < V1, perform the operation of modifying the porch at time t4; V1 is when the modification of the porch and the hardware interface DSI response cmd command are completed in the second frame, the latest time of modifying the porch is t3 and the second frame The duration corresponding to the timestamp corresponding to the Vsync signal; among them, t2≤t4≤t3.

For example, in a possible implementation, as shown in Figure 5A, in this embodiment T2 < V1, t4 = t2. In this embodiment, the modified porch and the hardware interface DSI response to the cmd command are both in the same frame. Completed within.

For example, in another possible implementation, as shown in Figure 5B, in this embodiment T2 < V1, t4 = t3. In this embodiment, the modification of the porch and the hardware interface DSI response to the cmd command are both in the same Completed within the frame.

For example, in another possible implementation, as shown in Figure 5C, in this embodiment, T2<V1, t2<t4<t3, in this embodiment, both the modified porch and the hardware interface DSI respond to the cmd command. Done within the same frame.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame. This can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes.

Please refer to FIG. 3B. FIG. 3B is a schematic flowchart of a display processing method provided by another embodiment of the present application. As shown in Figure 3B, the display processing method provided by the embodiment of the present application includes steps: 301 to 305. Next, steps 301 to 305 are introduced in detail.

301. When there is an image update, exit the idle state. The frame rate corresponding to the updated image is the second frame rate f2, and f2≠f1.

302. Determine the first duration T1. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the time displayed in the second frame. The earliest timestamp corresponding to the time when the driver can modify the blanking zone porch, and the second frame is the frame when the electronic device exits the idle state.

303. Determine T2 based on T1; where, T1=n*T+T2, T=1/f1, n is an integer, n≥0, 0<T2<T.

Since the computer uses floating point calculations, it is impossible to be accurate to an infinite number of digits. Therefore, in actual calculations, T1=n*T+T2 is a theoretical value. When T is an infinite loop number or an infinite non-loop number, the value of n exceeds The larger the cumulative error, the greater the error. In order to reduce the error, the following method can be used to determine T2. Determine the greatest common divisor between f1 and 1000 as x, y=1000/x; determine T2=(b%(y*1000)%T, where T1=a (second)+b (microsecond); determine based on T1 The value of T2 in the step after T2 uses the value of T2 determined in that step.

304. When T2 < V1, perform the operation of modifying the porch at time t4; V1 is when the modification of the porch and the hardware interface DSI response cmd command are completed in the second frame, the latest time of modifying the porch is t3 and the second frame The duration corresponding to the timestamp corresponding to the Vsync signal; among them, t2≤t4≤t3.

For example, in a possible implementation, as shown in Figure 5A, in this embodiment T2 < V1, t4 = t2. In this embodiment, the modified porch and the hardware interface DSI response to the cmd command are both in the same frame. Completed within.

For example, in another possible implementation, as shown in Figure 5B, in this embodiment T2 < V1, t4 = t3. In this embodiment, the modification of the porch and the hardware interface DSI response to the cmd command are both in the same Completed within the frame.

For example, in another possible implementation, as shown in Figure 5C, in this embodiment, T2<V1, t2<t4<t3, in this embodiment, both the modified porch and the hardware interface DSI respond to the cmd command. Done within the same frame.

305. When T2 < V1, in the next frame of the second frame, make the display screen display the image at the frame rate f2.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame, which can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes; in addition, in the second In the next frame of the second frame, the display screen displays the image at the frame rate f2, and the display screen can display the image at the new frame rate as soon as possible.

Please refer to FIG. 4A , which is a schematic flowchart of a display processing method provided by another embodiment of the present application. As shown in Figure 4A, the display processing method provided by the embodiment of the present application includes steps: 401 to 406. Next, steps 401 to 406 are introduced in detail.

401. When there is an image update, exit the idle state. The frame rate corresponding to the updated image is the second frame rate f2, and f2≠f1.

402. Determine the first duration T1. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the time displayed in the second frame. The earliest timestamp corresponding to the time when the driver can modify the blanking zone porch, and the second frame is the frame when the electronic device exits the idle state.

403. Determine T2 based on T1; where, T1=n*T+T2, T=1/f1, n is an integer, n≥0, 0<T2<T.

Since the computer uses floating point calculations, it is impossible to be accurate to an infinite number of digits. Therefore, in actual calculations, T1=n*T+T2 is a theoretical value. When T is an infinite loop number or an infinite non-loop number, the value of n exceeds The larger the cumulative error, the greater the error. In order to reduce the error, the following method can be used to determine T2. Determine the greatest common divisor between f1 and 1000 as x, y=1000/x; determine T2=(b%(y*1000)%T, where T1=a (second)+b (microsecond); determine based on T1 The value of T2 in the step after T2 uses the value of T2 determined in that step.

404. Determine whether T2 is less than V1.

If the judgment result is yes, step 405 is executed. If the judgment result is no, step 406 is executed.

405. Execute the operation of modifying the porch at time t4; V1 is the time corresponding to the Vsync signal of the second frame at the latest time t3 when modifying the porch and the hardware interface DSI response cmd command are completed in the second frame. The corresponding duration of the stamp; t2≤t4≤t3.

For example, in a possible implementation, as shown in Figure 5A, in this embodiment T2 < V1, t4 = t2. In this embodiment, the modified porch and the hardware interface DSI response to the cmd command are both in the same frame. Completed within.

For example, in another possible implementation, as shown in Figure 5B, in this embodiment T2 < V1, t4 = t3. In this embodiment, the modification of the porch and the hardware interface DSI response to the cmd command are both in the same Completed within the frame.

For example, in another possible implementation, as shown in Figure 5C, in this embodiment, T2<V1, t2<t4<t3, in this embodiment, both the modified porch and the hardware interface DSI respond to the cmd command. Done within the same frame.

406. Execute the operation of modifying the porch at time t6. t6 is in the third frame. The third frame is the next frame adjacent to the second frame. The timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T -V1); t6＝t5+T3, T _VSYNC +T _VBP <T3 <V1, T _VSYNC is the duration of the Vsync signal of the third frame, T _VBP is the duration corresponding to the back shoulder of the vertical blanking zone of the third frame .

For example, in a possible implementation, as shown in Figure 5D, in this embodiment T2>V1, in the third frame, the third frame is the next frame adjacent to the second frame, and the third frame The timestamp corresponding to the Vsync signal of the frame is t5, t5 = t3 + (T-V1); t6 = t5 + T3, T _VSYNC + T _VBP < T3 < V1, T _VSYNC is the duration of the Vsync signal of the third frame, T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame. In this embodiment, modifying the porch and the hardware interface DSI response to the cmd command are both completed in the third frame.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame. This can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes.

Please refer to FIG. 4B , which is a schematic flowchart of a display processing method provided by another embodiment of the present application. As shown in Figure 4B, the display processing method provided by the embodiment of the present application includes steps: 401 to 406. Next, steps 401 to 408 are introduced in detail.

401. When there is an image update, exit the idle state. The frame rate corresponding to the updated image is the second frame rate f2, f2≠f1.

402. Determine the first duration T1. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the time displayed in the second frame. The earliest timestamp corresponding to the time when the driver can modify the blanking zone porch, and the second frame is the frame when the electronic device exits the idle state.

403. Determine T2 based on T1; where, T1=n*T+T2, T=1/f1, n is an integer, n≥0, 0<T2<T.

Since the computer uses floating point calculations, it is impossible to be accurate to an infinite number of digits. Therefore, in actual calculations, T1=n*T+T2 is a theoretical value. When T is an infinite loop number or an infinite non-loop number, the value of n exceeds The larger the cumulative error, the greater the error. In order to reduce the error, the following method can be used to determine T2. Determine the greatest common divisor between f1 and 1000 as x, y=1000/x; determine T2=(b%(y*1000)%T, where T1=a (second)+b (microsecond); determine based on T1 The value of T2 in the step after T2 uses the value of T2 determined in that step.

404. Determine whether T2 is less than V1.

If the judgment result is yes, step 405 is executed. If the judgment result is no, step 406 is executed.

405. Execute the operation of modifying the porch at time t4; V1 is the time corresponding to the Vsync signal of the second frame at the latest time t3 when modifying the porch and the hardware interface DSI response cmd command are completed in the second frame. The corresponding duration of the stamp; t2≤t4≤t3.

For example, in a possible implementation, as shown in Figure 5A, in this embodiment T2 < V1, t4 = t2. In this embodiment, the modified porch and the hardware interface DSI response to the cmd command are both in the same frame. Completed within.

For example, in another possible implementation, as shown in Figure 5B, in this embodiment T2 < V1, t4 = t3. In this embodiment, the modification of the porch and the hardware interface DSI response to the cmd command are both in the same Completed within the frame.

For example, in another possible implementation, as shown in Figure 5C, in this embodiment, T2<V1, t2<t4<t3, in this embodiment, both the modified porch and the hardware interface DSI respond to the cmd command. Done within the same frame. Then, step 407 is executed.

406. Execute the operation of modifying the porch at time t6. t6 is in the third frame. The third frame is the next frame adjacent to the second frame. The timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T -V1); t6＝t5+T3, T _VSYNC +T _VBP <T3 <V1, T _VSYNC is the duration of the Vsync signal of the third frame, T _VBP is the duration corresponding to the back shoulder of the vertical blanking zone of the third frame .

For example, in a possible implementation, as shown in Figure 5D, in this embodiment T2>V1, in the third frame, the third frame is the next frame adjacent to the second frame, and the third frame The timestamp corresponding to the Vsync signal of the frame is t5, t5 = t3 + (T-V1); t6 = t5 + T3, T _VSYNC + T _VBP < T3 < V1, T _VSYNC is the duration of the Vsync signal of the third frame, T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame. In this embodiment, modifying the porch and responding to the cmd command of the hardware interface DSI are both completed in the third frame, and then step 408 is executed.

407. In the next frame of the second frame, cause the display screen to display the image at the frame rate f2.

408. In the next frame of the third frame, cause the display screen to display the image at the frame rate f2.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame, which can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes; in addition, in the second In the next frame of the second frame, the display screen displays the image at the frame rate f2, and the display screen can display the image at the new frame rate as soon as possible.

Corresponding to the previous method embodiments, embodiments of the present application also provide a display processing device, which is applied to electronic equipment. The display screen of the electronic equipment is in the standby idle state at the first frame rate f1. The device includes: a first processing unit, a first a determining unit, a second determining unit and a modifying unit. Among them, the first processing unit is used to exit the idle state when there is an image update, and the frame rate corresponding to the updated image is the second frame rate f2, f2≠f1; the first determination unit is used to determine the first duration T1, The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the earliest time in the second frame that the display driver can modify the blanking zone porch. The timestamp corresponding to the moment, the second frame is the frame when the electronic device exits the idle state; the second determination unit is used to determine T2 based on T1; where, T1=n*T+T2, T=1/f1, n It is an integer, n≥0, 0＜T2＜T; the modification unit is used to perform the operation of modifying the porch at time t4 when T2＜V1; V1 satisfies the modification of the porch and the hardware interface DSI response cmd command in the second When completed within the frame, modify the duration corresponding to the latest time t3 of the porch and the timestamp corresponding to the Vsync signal of the second frame; where t2 ≤ t4 ≤ t3.

In a possible implementation, the display processing device further includes: a first display unit, configured to display the image in the next frame of the second frame when T2 < V1.

In a possible implementation, the modification unit is also used to perform the operation of modifying the porch at time t6 when T2 ≥ V1. t6 is within the third frame, and the third frame is the next frame adjacent to the second frame. , the timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T-V1); t6=t5+T3, the T _VSYNC + T _VBP < T3 < V1, the T _VSYNC is the third The Vsync signal of the frame corresponds to the duration, and the T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame.

In a possible implementation, the display processing device further includes: a second display unit, configured to display the image with f2 in the next frame of the third frame when T2≥V1.

In a possible implementation, in determining T2 based on T1, the second determination unit is specifically used to determine that the greatest common divisor between f1 and 1000 is x, y=1000/x; determine T2=(b%(y* 1000)%T, where T1 = a (second) + b (microsecond); the value of T2 in the modification unit uses the value of T2 determined by the second determination unit.

When using this technical solution for display processing, the operation of modifying the porch and the DSI response to the cmd command are completed in the same frame, which can avoid screen blur when the electronic device exits the standby state and the frame rate of the image to be displayed changes; in addition, in the second In the next frame of the second frame, the display screen displays the image at the frame rate f2, and the display screen can display the image at the new frame rate as soon as possible.

Referring to Figure 6, the embodiment of the present application also provides an electronic device 600 that implements the above display processing method. As shown in Figure 6, the electronic device 600 may include a processor 610, an external memory interface 620, an internal memory 621, a universal serial Bus (universal serial bus, USB) interface 630, charging management module 640, power management module 641, battery 642, antenna 1, antenna 2, mobile communication module 650, wireless communication module 660, audio module 670, speaker 670A, receiver 670B, Microphone 670C, headphone interface 670D, sensor module 680, button 690, motor 691, indicator 692, camera 693, screen 694, and subscriber identification module (subscriber identification module, SIM) card interface 695, etc. Among them, the sensor module 680 may include a pressure sensor 680A, a gyro sensor 680B, an air pressure sensor 680C, a magnetic sensor 680D, an acceleration sensor 680E, a distance sensor 680F, a proximity light sensor 680G, a fingerprint sensor 680H, a temperature sensor 680J, a touch sensor 680K, and an environment. Light sensor 680L, bone conduction sensor 680M, etc.

The processor 610 may include one or more processing units. For example, the processor 610 may include an AP, a CP, a modem processor, a graphics processing unit (GPU), and an image signal processor (ISP). , controller, memory, video codec, digital signal processor (DSP), baseband processor, and/or neural network processing unit (NPU), etc. Among them, different processing units can be independent devices or integrated in one or more processors.

The controller may be the nerve center and command center of the electronic device 600 . The controller can generate operation control signals based on the instruction operation code and timing signals to complete the control of fetching and executing instructions.

The processor 610 may also be provided with a memory for storing instructions and data. In some embodiments, the memory in processor 610 is cache memory. This memory may hold instructions or data that have been recently used or recycled by processor 610 . If the processor 610 needs to use the instructions or data again, it can be called directly from the memory. Repeated access is avoided and the waiting time of the processor 610 is reduced, thus improving the efficiency of the system. The processor can also set low-power memory (for example, Island low-power, etc.) to reduce power consumption.

The electronic device 600 implements display functions through a GPU, a screen 694, an application processor, and the like. The GPU is an image processing microprocessor and is connected to the screen 694 and the application processor. GPUs are used to perform mathematical and geometric calculations for graphics rendering. Processor 610 may include one or more GPUs that execute program instructions to generate or alter display information.

Screen 694 is used to display images, videos, etc. Screen 694 includes a display panel. The display panel can use a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active matrix organic light emitting diode or an active matrix organic light emitting diode (active-matrix organic light emitting diode). , AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-OLED, quantum dot light emitting diode (quantum dot light emittingdiodes, QLED), etc. In some embodiments, electronic device 600 may include 1 or N screens 694, N being an integer greater than 1.

The electronic device 600 can implement the shooting function through an ISP, a camera 693, a video codec, a GPU, a screen 694 and an application processor.

The ISP is used to process the data fed back by the camera 693. For example, when taking a photo, the shutter is opened, the light is transmitted through the lens to the camera sensor, the optical signal is converted into an electrical signal, and the camera sensor passes the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin color. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some embodiments, the ISP may be provided in camera 693.

Camera 693 is used to capture still images or video. The object passes through the lens to produce an optical image that is projected onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then passes the electrical signal to the ISP to convert it into a digital image signal. ISP outputs digital image signals to DSP for processing. DSP converts digital image signals into standard RGB, YUV and other format image signals. In some embodiments, the electronic device 600 may include 1 or N cameras 693, where N is an integer greater than 1.

The external memory interface 620 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the electronic device 600 . The external memory card communicates with the processor 610 through the external memory interface 620 to implement the data storage function. For example, save music, video and other files on an external memory card.

Internal memory 621 may be used to store computer-executable program code, which includes instructions. The processor 610 executes various functional applications and data processing of the electronic device 600 by executing instructions stored in the internal memory 621 . The internal memory 621 may include a program storage area and a data storage area. Among them, the stored program area can store an operating system, at least one application program required for a function (such as a sound playback function, an image playback function, etc.). The storage data area may store data created during use of the electronic device 600 (such as audio data, phone book, etc.). In addition, the internal memory 621 may include high-speed random access memory, and may also include non-volatile memory, such as at least one disk storage device, flash memory device, universal flash storage (UFS), etc.

The acceleration sensor 680E can detect the acceleration of the electronic device 600 in various directions (generally three axes). When the electronic device 600 is stationary, the magnitude and direction of gravity can be detected. The acceleration sensor 680E can also be used to identify the posture of the electronic device 600 and be used for horizontal and vertical screen switching, pedometer and other applications. Of course, the acceleration sensor 680E can also be combined with the gyro sensor 680B to identify the posture of the electronic device 600 and be used for switching between horizontal and vertical screens.

The gyro sensor 680B may be used to determine the motion posture of the electronic device 400 . In some embodiments, the angular velocity of electronic device 600 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 680B. The gyro sensor 680B can be used for image stabilization. For example, when the shutter is pressed, the gyro sensor 680B detects the angle at which the electronic device 600 shakes, calculates the distance that the lens module needs to compensate based on the angle, and allows the lens to offset the shake of the electronic device 600 through reverse movement to achieve anti-shake. The gyro sensor 680B can also be used for horizontal and vertical screen switching, navigation, and somatosensory gaming scenarios.

It can be understood that the structure illustrated in the embodiment of the present application does not constitute a specific limitation on the electronic device 600 . In other embodiments of the present application, the electronic device 600 may include more or fewer components than shown in the figures, or some components may be combined, some components may be separated, or some components may be arranged differently. The components illustrated may be implemented in hardware, software, or a combination of software and hardware.

The electronic device provided by the embodiment of the present application may be a user equipment (UE), such as a mobile terminal (such as a mobile phone).

In addition, an operating system runs on top of the above components. For example, it can be the Android open source operating system developed by Google.

The software system of electronic equipment can adopt layered architecture, event-driven architecture, microkernel architecture, microservice architecture, or cloud architecture, etc. In order to more clearly illustrate the touch operation recognition method provided by the embodiment of the present application, the embodiment of the present application takes the Android system with a layered architecture as an example to illustrate the software system of the electronic device.

The above-mentioned FIG. 6 is only a composition example of an electronic device. Referring to FIG. 7 , another example of the composition of an electronic device is provided according to an embodiment of the present application.

In this example, the software system of the electronic device may adopt a layered architecture, an event-driven architecture, a microkernel architecture, a microservice architecture, or a cloud architecture. The embodiment of this application uses a layered architecture The system is taken as an example to illustrate the software structure of the electronic device.

The layered architecture divides the software into several layers, and each layer has clear roles and division of labor. The layers communicate through software interfaces. In some embodiments, the The system is divided into five layers, from top to bottom: application layer, application framework layer, Android runtime (ART) and native C/C++ library, hardware abstraction layer (Hardware Abstract Layer, HAL) and kernel layer .

The application layer can include a series of application packages.

As shown in Figure 7, the electronic device may include a hardware layer and a software layer, wherein the Android system with a layered architecture may include an application layer, an application framework layer, a system library layer and a kernel layer. In some optional embodiments, the system of the electronic device may also include layers not mentioned in the above technical architecture, such as Android Runtime. The application layer can include a series of application packages, such as navigation applications, music applications, video applications, and knuckle-tapping screen applications. The application package can include applications such as video and chat, as well as system user interface (SystemUI). Knuckle tapping screen applications can be used for screenshots, screen recordings, long screenshots, regional screenshots, etc. In this example, the application package also includes applications such as contact lookup.

Video, chat and other applications are used to provide users with corresponding services. For example, users use video applications to watch videos, use chat applications to chat with other users, use music applications to listen to music, and use video synthesis to generate recall videos using existing images and videos, etc.

SystemUI is used to manage a human-computer interaction interface (UI) of an electronic device. In this embodiment of the present application, SystemUI is used to monitor touch operations on the touch screen.

The application framework layer provides an application programming interface (API) and programming framework for applications in the application layer. The application framework layer includes some predefined functions. The application framework layer can include window management service module (window management service, WMS), display rotation module (also known as DisplayRotation), application management service module (activity management service, AMS), input management module (also known as Input) and image processing Modules etc.

WMS is used to manage window programs. The window manager can obtain the screen size, determine whether there is a status bar, cut out the image on the screen to capture the screen, etc. In this embodiment of the present application, WMS can create and manage windows corresponding to applications.

The display rotation module is used to control the rotation of the screen so that the screen presents a vertical or horizontal screen layout. For example, when it is determined that screen rotation is required, Surfaceflinger is notified to switch the application interface between horizontal and vertical screens.

AMS is used to launch specific applications based on user operations. For example, after the image synthesis operation is completed, the trigger image is displayed on the screen. After the image is displayed, the trigger performs a cutout operation on the image that is determined to need to be cutout, and creates an application stack corresponding to the video application, so that The video application works normally.

The system library layer can include multiple functional modules, such as sensor module (also known as sensor) and SurfaceFlinger.

The sensor module is used to obtain data collected by the sensor, such as collecting the ambient light under the screen. Collect gravity direction information of electronic devices. Alternatively, the sensor module can also adjust the brightness of the screen according to the ambient light, and determine the horizontal and vertical screen status information of the electronic device based on the gravity direction information of the electronic device. The horizontal and vertical screen status information is used to indicate whether the electronic device is in the horizontal or vertical screen state.

Surfaceflinger is a system service used for layer creation, control and management functions.

In addition, the system library layer can also include: surface manager (surface manager), media libraries (MediaLibraries), 3D graphics processing libraries (such as: OpenGL ES), 2D graphics engines (such as: SGL), etc. The surface manager is used to manage the display subsystem and provides the fusion of 2D and 3D layers for multiple applications. The media library supports playback and recording of a variety of commonly used audio and video formats, as well as static image files, etc. The media library can support a variety of audio and video encoding formats, such as: MPEG4, H.264, MP3, AAC, AMR, JPG, PNG, etc. The 3D graphics processing library is used to implement 3D graphics drawing, image rendering, composition, and layer processing. 2D Graphics Engine is a drawing engine for 2D drawing.

The kernel layer is the layer between hardware and software. In this embodiment of the present application, the core layer at least includes a touch driver module and a display driver module.

The display driver module is used to display the synthesized image on the screen according to the image data provided by the module of the application framework layer and the application program of the application layer. For example, the video application transfers one frame of image data of the video to the display driver module, and the display driver module displays one frame of image in the video on the touch screen based on the image data. SystemUI passes the image data to the display driver module, and the display driver module displays the synthesized image on the screen.

The touch driver module is used to monitor the capacitance data of each area of the touch screen. When the user clicks or slides on the touch screen, the capacitance value of the clicked or slid area will change. The touch driver module can detect the changes in the capacitance value of each area on the touch screen and send a message of the capacitance value change to the input management module. , the capacitance value data change message carries information such as the change amplitude of the capacitance value in each area of the touch screen and the time of change.

The input management module can determine the touch operation based on the reported capacitance value change message, and then send the recognized touch operation to other modules. The touch operations here may include knuckle tapping operations, clicking operations, dragging operations, and specific gesture operations (such as upward sliding gesture operations, horizontal sliding gesture operations, etc.).

The hardware layer includes the screen and ambient light sensor. The ambient light sensor is used to detect ambient light information under the screen. The application processor monitors the touch operation on the touch screen. The baseband processor monitors the acceleration data and stores the monitored acceleration data to the storage module. When the AP detects the touch operation, the CP identifies the touch based on the acceleration data stored in the storage module. Control whether the operation is a knuckle tapping action; the CP sends the recognition result to the AP.

The above technical architecture lists the modules and devices in electronic equipment that may be involved in this application. In practical applications, the electronic device may include all or part of the modules and devices of the above technical architecture, as well as other modules and devices not mentioned in the above technical architecture. Of course, it may also include only the modules and devices of the above technical architecture. This embodiment There is no restriction on this.

An embodiment of the present application also provides an electronic device. The electronic device includes a processor, a display, and a memory. The memory is used to store computer programs. The display is used to display images. The processor is used to read images from the memory. The computer program is called and run in the processor, so that the processor executes the display processing method as described in any of the previous method embodiments.

An embodiment of the present application also provides a chip, including a processor. When the processor executes instructions, the processor executes the display processing method described in any of the previous method embodiments.

Embodiments of the present application also provide a computer-readable storage medium that stores a computer program. When the computer program is executed by a processor, the steps in each of the above method embodiments can be implemented.

Embodiments of the present application provide a computer program product. The computer program product includes a computer program. When the computer program is executed by a processor, the steps in each of the above method embodiments can be implemented.

This application implements all or part of the processes in the methods of the above embodiments, which can be completed by instructing relevant hardware through a computer program. The computer program can be stored in a computer-readable storage medium, and the computer program is executed by the processor. When , the steps of each of the above method embodiments can be implemented. Wherein, the computer program includes computer program code, which may be in the form of source code, object code, executable file or some intermediate form. The computer-readable medium may at least include: any entity or device capable of carrying computer program code to a camera/electronic device, a recording medium, a computer memory, a read-only memory (ROM), or a random access memory. (random access memory, RAM), electrical carrier signals, telecommunications signals, and software distribution media. For example, U disk, mobile hard disk, magnetic disk or CD, etc. In some jurisdictions, subject to legislation and patent practice, computer-readable media may not be electrical carrier signals and telecommunications signals.

In the above embodiments, each embodiment is described with its own emphasis. For parts that are not detailed or documented in a certain embodiment, please refer to the relevant descriptions of other embodiments.

Those of ordinary skill in the art will appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented with electronic hardware, or a combination of computer software and electronic hardware. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Skilled artisans may implement the described functionality using different methods for each specific application, but such implementations should not be considered beyond the scope of this application.

In the embodiments provided in this application, it should be understood that the disclosed methods and electronic devices can be implemented in other ways. For example, the apparatus/network equipment embodiments described above are only illustrative. For example, the division of modules or units is only a logical function division. In actual implementation, there may be other division methods, such as multiple units. Or components can be combined or can be integrated into another system, or some features can be omitted, or not implemented. On the other hand, the coupling or direct coupling or communication connection between each other shown or discussed may be through some interfaces, indirect coupling or communication connection of devices or units, which may be in electrical, mechanical or other forms.

The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place, or they may be distributed to multiple network units. Some or all of the units can be selected according to actual needs to achieve the purpose of the solution of this embodiment.

It will be understood that, when used in this specification and the appended claims, the term "comprising" indicates the presence of the described features, integers, steps, operations, elements and/or components but does not exclude one or more other The presence or addition of features, integers, steps, operations, elements, components and/or collections thereof.

It will also be understood that the term "and/or" as used in this specification and the appended claims refers to and includes any and all possible combinations of one or more of the associated listed items.

Reference in this specification to "one embodiment" or "some embodiments" or the like means that a particular feature, structure or characteristic described in connection with the embodiment is included in one or more embodiments of the application. Therefore, the phrases "in one embodiment", "in some embodiments", "in other embodiments", "in other embodiments", etc. appearing in different places in this specification are not necessarily References are made to the same embodiment, but rather to "one or more but not all embodiments" unless specifically stated otherwise. The terms “including,” “includes,” “having,” and variations thereof all mean “including but not limited to,” unless otherwise specifically emphasized.

The above-described embodiments are only used to illustrate the technical solutions of the present application, but not to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still implement the above-mentioned implementations. The technical solutions described in the examples are modified, or some of the technical features are equivalently replaced; and these modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions in the embodiments of this application, and should be included in within the protection scope of this application.

Claims (13)

1. A display processing method, characterized in that it is applied to an electronic device, the display screen of the electronic device is in a standby idle state at a first frame rate f1, the method includes: When there is an image update, exit the idle state, the frame rate corresponding to the updated image is the second frame rate f2, and the f2≠f1; Determine the first duration T1, the starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame, the first frame is the frame when the electronic device enters the idle state; the end point t2 of T1 is the timestamp corresponding to the earliest moment when the display driver can modify the blanking zone porch in the second frame, which is the frame in which the electronic device exits the idle state; Determine T2 according to the T1; wherein, the T1=n*T+T2, the T=1/f1, the n is an integer, n≥0, 0<T2<T; When T2 < V1, the operation of modifying the porch is performed at time t4; the V1 is the latest time to modify the porch when the modification of the porch and the hardware interface DSI response cmd command are both completed within the second frame. The duration corresponding to time t3 and the timestamp corresponding to the Vsync signal of the second frame; wherein, t2≤t4≤t3. 2. The method according to claim 1, characterized in that, the method further comprises: When T2 < V1, in the next frame of the second frame, the display screen displays the image with f2. 3. The method according to claim 1, characterized in that, When T2≥V1, the operation of modifying the porch is performed at time t6. The t6 is within the third frame. The third frame is the next frame adjacent to the second frame. The third frame The timestamp corresponding to the Vsync signal of the frame is t5, t5=t3+(T-V1); t6=t5+T3, the T _VSYNC + T _VBP < T3 < V1, the T _VSYNC is the Vsync of the third frame For the duration of the signal, the T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame. 4. The method according to claim 3, characterized in that the method further includes: When T2≥V1, in the next frame of the third frame, the display screen displays the image with f2. 5. The method according to any one of claims 1 to 4, wherein determining T2 according to T1 includes: determining the greatest common divisor of f1 and 1000 as x, y=1000/x; Determine T2=(b%(y*1000)%T, where T1=a(second)+b(microsecond); In the step after determining T2 based on T1, the value of T2 uses the value of T2 determined in this step. 6. A display processing device, characterized in that it is applied to electronic equipment, the display screen of the electronic equipment is in a standby idle state at a first frame rate f1, and the device includes: The first processing unit is configured to exit the idle state when there is an image update, the frame rate corresponding to the updated image is the second frame rate f2, and the f2≠f1; The first determination unit is used to determine the first duration T1. The starting point t1 of T1 is the timestamp corresponding to the vertical synchronization Vsync signal of the first frame. The first frame is the frame in which the electronic device enters the idle state. ; The end point t2 of T1 is the timestamp corresponding to the earliest time when the display driver can modify the blanking zone porch in the second frame, and the second frame is the frame in which the electronic device exits the idle state; The second determination unit is used to determine T2 according to the T1; wherein the T1=n*T+T2, the T=1/f1, the n is an integer, n≥0, 0<T2<T; A modification unit configured to perform the operation of modifying the porch at time t4 when T2 < V1; the V1 is when modifying the porch and the hardware interface DSI response cmd command are both completed within the second frame, Modify the duration corresponding to the latest time t3 of the porch and the timestamp corresponding to the Vsync signal of the second frame; where, t2≤t4≤t3. 7. The device according to claim 6, characterized in that the device further comprises: The first display unit is configured to display an image with f2 in the next frame of the second frame when T2<V1. 8. The device according to claim 6, characterized in that, The modification unit is also configured to perform the operation of modifying the porch at time t6 when T2≥V1, where t6 is within the third frame, and the third frame is adjacent to the second frame. In the next frame, the timestamp corresponding to the Vsync signal of the third frame is t5, t5=t3+(T-V1); t6=t5+T3, the T _VSYNC + T _VBP < T3 < V1, the T _VSYNC is the duration of the Vsync signal of the third frame, and the T _VBP is the duration corresponding to the trailing shoulder of the vertical blanking zone of the third frame. 9. The device according to claim 8, characterized in that the device further comprises: The second display unit is configured to display an image with f2 in the next frame of the third frame when T2≥V1. 10. The device according to any one of claims 6 to 9, characterized in that, in determining T2 based on T1, the second determination unit is specifically configured to determine the greatest common divisor of f1 and 1000 as x, y=1000/x; determine T2=(b%(y*1000)%T, where T1=a(second)+b(microsecond); The value of T2 in the modification unit uses the value of T2 determined in this step. 11. An electronic device, characterized in that the electronic device includes a processor, a display and a memory, the memory is used to store computer programs, the display is used to display images, and the processor is used to retrieve images from the memory. Calling and running the computer program causes the processor to execute the display processing method described in any one of claims 1 to 5. 12. A chip, characterized in that it includes a processor, and when the processor executes instructions, the processor executes the display processing method according to any one of claims 1 to 5. 13. A computer-readable storage medium, characterized in that the computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the processor causes the processor to execute any one of claims 1 to 5. The display processing method.