WO2023046164A1

WO2023046164A1 - Image display method, ddic, display screen module, and terminal

Info

Publication number: WO2023046164A1
Application number: PCT/CN2022/121325
Authority: WO
Inventors: 高延凯; 王月文; 蔡辉跃
Original assignee: Oppo广东移动通信有限公司
Priority date: 2021-09-26
Filing date: 2022-09-26
Publication date: 2023-03-30
Also published as: CN113781949A; CN113781949B

Abstract

An image display method, a DDIC, a display screen module, and a terminal. The method comprises: a DDIC receives an nth frame of image data sent by an AP, n being a positive integer; when a historical sending and displaying rate of the AP satisfies a display delay condition, the DDIC performs a display delay operation on the nth frame of image data, the display delay operation being used for delaying display of an nth image frame; and when the display delay operation is completed, the DDIC controls, on the basis of the nth frame of image data, a display screen to display the nth image frame.

Description

Image display method, DDIC, display module and terminal

This application claims the priority of the Chinese patent application with the application number 202111130179.9 and the title of the invention "image display method, DDIC, display module and terminal" filed on September 26, 2021, the entire contents of which are incorporated herein by reference. Applying.

technical field

The embodiments of the present application relate to the field of display technologies, and in particular to an image display method, DDIC, display screen module and terminal.

Background technique

With the continuous development of display technology, more and more displays that can support high refresh rate display have emerged as the times require. When running high frame rate applications or during sliding operations, by setting the display to high refresh rate mode It can improve the fluency of the picture.

For a display screen that adopts the application processor (Application Processor, AP)-display driver integrated circuit (DDIC)-panel (Panel) drive architecture, during the image display process, the DDIC outputs the frame rate according to the AP (that is, the output image Data rate) adaptively adjusts the refresh frequency to realize adaptive frequency conversion.

However, because the output frame rate of the AP will fluctuate within a certain range, it will cause the refresh rate of the DDIC to fluctuate. When the refresh rate jumps sharply, there will be screen flickering and shaking problems, which will affect the image display quality.

Contents of the invention

Embodiments of the present application provide an image display method, a DDIC, a display screen module, and a terminal. Described technical scheme is as follows:

On the one hand, an embodiment of the present application provides an image display method for a DDIC of a display screen, the method comprising:

Receive the nth frame of image data sent by the AP, where n is a positive integer;

When the historical display rate of the AP satisfies the display delay condition, perform a display delay operation on the nth frame of image data, and the display delay operation is used to delay displaying the nth frame of image;

When the display delay operation is completed, the display screen is controlled to display the nth frame of image based on the nth frame of image data.

On the other hand, an embodiment of the present application provides a DDIC, the DDIC chip is applied to a display screen, and the DDIC is used for:

When the historical display rate of the AP satisfies the display delay condition, perform a display delay operation on the nth frame of image data, and the display delay operation is used to delay image display;

On the other hand, an embodiment of the present application provides a display screen module, the display screen module includes a display screen and a DDIC, the DDIC is used to drive the display screen, and the DDIC is used to realize the The image display method described above.

On the other hand, an embodiment of the present application provides a terminal. The terminal includes an application processor AP, a display screen, and a display driver chip DDIC. The AP and the DDIC are connected through a mobile industry processor interface MIPI. The DDIC is used to realize the image display method described in the above aspect.

Description of drawings

Figure 1 is a schematic diagram of the image display process under the AP-DDCI-Panel architecture;

Fig. 2 is a schematic diagram of the principle of the image data transmission method provided by the embodiment of the present application;

FIG. 3 shows a flowchart of an image display method shown in an exemplary embodiment of the present application;

Figure 4 is a comparison chart of the refresh rate when the display delay mechanism is introduced and when the display delay mechanism is not introduced;

Fig. 5 shows a flowchart of an image display method shown in another exemplary embodiment of the present application;

Fig. 6 is a schematic diagram of Vsync, VBP, Vact and VFP shown in an exemplary embodiment;

Fig. 7 is an implementation schematic diagram of a display delay process shown in an exemplary embodiment of the present application;

Fig. 8 is an implementation schematic diagram of a display delay process shown in another exemplary embodiment of the present application;

Fig. 9 is an implementation schematic diagram of an image rescanning process shown in an exemplary embodiment of the present application;

FIG. 10 is a flowchart of an image display process provided by another embodiment of the present application;

Fig. 11 shows a structural block diagram of a terminal provided by an exemplary embodiment of the present application.

Detailed ways

In order to make the purpose, technical solution and advantages of the present application clearer, the implementation manners of the present application will be further described in detail below in conjunction with the accompanying drawings.

The "plurality" mentioned herein means two or more. "And/or" describes the association relationship of associated objects, indicating that there may be three types of relationships, for example, A and/or B may indicate: A exists alone, A and B exist simultaneously, and B exists independently. The character "/" generally indicates that the contextual objects are an "or" relationship.

As shown in Figure 1, under the AP-DDIC-Panel architecture, the AP side first performs layer drawing and rendering through the application (Application, App), and then performs layer synthesis on the drawn layers through SurfaceFlinger (layer synthesizer) Get the image data, and then send the image data to display (write) DDIC through MIPI. The DDIC stores the image data sent by the AP in the buffer (Buffer), and controls the display (Panel) to perform image refresh display (Display) by scanning (reading) the image data in the Buffer. When implementing adaptive frequency conversion, the DDIC will adaptively adjust the refresh frequency according to the display sending rate of the AP (that is, the amount of image data that the AP sends to the DDIC per unit time, or the speed at which the AP sends image data to the DDIC). For example, when the output frame rate of the AP decreases, the DDIC lowers the refresh rate, and when the output frame rate of the AP increases, the DDIC increases the refresh rate.

In the process of adaptive frequency conversion, the refresh frequency changes in a small range in a short time without affecting the image display quality, but when the refresh frequency changes in a large range (that is, a large jump) in a short time, problems such as flickering and jitter will occur , affecting image display quality.

For example, in some scenarios, due to fluctuations in the speed of preparing image data on the AP side, the display rate of the AP changes from 60 Hz to 45 Hz in a short period of time, and then changes from 45 Hz to 72 Hz, and the refresh rate of the DDIC changes from 60 Hz. When changing to 45Hz, it will not cause flickering and jittering of the screen, but when the refresh rate of DDIC changes from 45Hz to 72Hz, the flickering and jittering of the screen will appear because the refresh rate changes too much.

In order to solve the above technical problems, in the embodiment of the present application, a display delay mechanism is introduced on the DDIC side. Under this mechanism, as shown in Figure 2, after receiving the image data sent by the AP, the DDIC detects the display delay condition of the historical display rate of the AP according to the receiving time position of the image data, and when it detects that the display delay condition is satisfied When using the refresh rate stabilization algorithm, the display delay operation is performed on the image data to avoid the large jump in the refresh rate of the DDIC caused by scattered acceleration requests on the AP side, and achieve the effect of stabilizing the refresh rate of the DDIC, thereby reducing the flickering of the display screen caused by this. question. Wherein, the historical display sending rate is the transmission rate when the AP transmits image data of several frames before the current display frame to the DDIC.

For example, in the process of running a game application with a reference frame rate of 60FPS, when the refresh rate of DDIC for the n-1th frame is less than 60Hz, and the AP sends the image data of the nth frame in advance (that is, the frequency of sending image data is greater than 60Hz time), if the DDIC immediately controls the display screen to display images according to the image data of the nth frame, the refresh rate of the DDIC will jump (for example, from 45Hz to 72Hz); Display rate, when it is determined that the image of the nth frame meets the display delay condition, the display delay operation is performed on the image of the nth frame, that is, after receiving the image data of the nth frame, the display is delayed for a period of time before the display is controlled to display the image, avoiding the refresh rate of DDIC A large jump occurs (for example, the refresh rate changes from 72Hz to 60Hz after display delay operation).

The method provided in the embodiment of this application is applied to a terminal, and the DDIC in the terminal display screen executes the above image display method. The terminal may include a smart phone, a tablet computer, a wearable device (such as a smart watch), a portable personal computer, a smart TV, etc. The embodiment of the present application does not limit the specific type of the terminal.

Please refer to FIG. 3 , which shows a flowchart of an image display method according to an exemplary embodiment of the present application. The method includes:

Step 301, receiving the nth frame of image data sent by the AP, where n is a positive integer.

When the DDIC is ready to refresh the next frame of image, it will output a tearing effect (Tearing Effect, TE) signal. By detecting the TE signal, the AP sends the prepared image data to the DDIC, and the DDIC performs image scanning (or called frame scanning) . Wherein, the TE signal output by the DDIC may be a single-TE (single TE) signal or a multiple-TE (multiple TE) signal. The single-TE signal is a continuous high-level TE signal output by DDIC, and the multiple-TE signal is a continuous TE signal of DDIC according to a preset frequency, where the preset frequency can be the light-emitting frequency of the display screen, for example, DDIC The output frequency of the multiple-TE signal is 360Hz. Correspondingly, when the DDIC outputs a single-TE signal, the AP transmits new image data to the DDIC when it detects that the TE signal is in a high-level state; when the DDIC outputs a multiple-TE signal, the AP detects the rising edge of the TE signal , transfer new image data to DDIC.

When the image rendering speed on the AP side is accelerated (the image rendering speed is related to factors such as the complexity of the image), the AP will send the display at a faster speed than the current display rate, that is, compared to sending the image in advance , correspondingly, the DDIC scans the image immediately after receiving the image data, and the refresh frequency of the DDIC will increase accordingly; After the image data is scanned, the refresh frequency of the DDIC will be reduced accordingly. However, if the DDIC scans the image immediately after receiving the image data, in the case of large fluctuations in the image rendering speed, sporadic acceleration requests on the AP side will cause the refresh rate of the DDIC to jump, causing the screen to flicker. Among them, the phenomenon that the image data preparation speed on the AP side rises sharply in a short period of time and cannot be maintained for a long time (that is, the image data preparation speed on the AP side will drop sharply in a short period of time) is called sporadic acceleration. The image data transmitted by the AP to the DDIC during acceleration is regarded as a sporadic acceleration request.

Step 302: When the historical display rate of the AP satisfies the display delay condition, perform a display delay operation on the nth frame of image data, and the display delay operation is used to delay display of the nth frame of image.

In order to reduce refresh frequency fluctuations and avoid screen flickering, in the embodiment of this application, after receiving the image data sent by the AP, the DDIC needs to detect whether the nth frame image meets the display delay condition according to the historical display rate of the AP. Whether the acceleration request is a sporadic acceleration request, and when the acceleration request is a sporadic acceleration request (that is, when the display delay condition is satisfied), the display delay operation is performed on the nth frame of image data, and the display of the nth frame of image is delayed.

Optionally, the historical display sending rate is used to characterize the rate at which the AP sends image data in a recent period. In some embodiments, based on the historical display rate, the DDIC can identify whether the AP has continuously sent the display in advance in the recent period of time, and then filter the sporadic acceleration requests on the AP side (that is, filter the non-continuous early display), to avoid the sporadic The acceleration request causes the refresh frequency of DDIC to jump greatly.

In a possible implementation manner, the display delay operation DDIC performs the display delay operation based on the target refresh frequency, so that the refresh frequency of the DDIC is stabilized at the target refresh frequency.

Step 303 , when the display delay operation is completed, control the display screen to display the nth frame of image based on the nth frame of image data.

After completing the display delay operation on the nth frame of image data, the DDIC performs image scanning, and controls the display screen to display the nth frame of image based on the nth frame of image data.

Using the solution provided by the embodiment of this application, the DDIC filters the sporadic acceleration requests of the AP to improve the stability of the refresh frequency of the DDIC; at the same time, the display delay mechanism is controlled by the DDIC through hardware logic, without the need for AP control, which helps to improve Timeliness and accuracy of the control process.

In a schematic example, as shown in Figure 4, without introducing a display delay mechanism, during the process of displaying the fifth and sixth frames, the refresh frequency of the DDIC jumps from 45Hz to 72Hz. During the process of displaying the 13th and 14th frames, the refresh frequency of DDIC jumps from 51Hz to 72Hz. After introducing the display delay mechanism, the refresh frequency of DDIC changes from 45Hz to 60Hz during the display of the fifth and sixth frames, and changes from 45Hz to 60Hz during the display of the 13th and 14th frames. 51Hz jumps to 60Hz.

To sum up, in the embodiment of this application, by introducing the display delay mechanism, after the DDIC receives the image data sent by the AP, it determines whether the display delay condition is met based on the historical display rate of the AP, and when the display delay condition is met, delays Image display process; compared to DDIC displaying the image immediately after receiving the image data sent by the AP, by setting the display delay condition, it is possible to filter the sporadic acceleration request of the AP (that is, the temporary increase of the display rate of the AP causes the image data to be sent to the display in advance. , and the display rate after the temporary increase cannot be maintained), to avoid the DDIC refresh frequency jumping greatly due to the fluctuation of the AP output frame rate to the display rate, which in turn leads to the problem of flickering and jittering of the screen, and helps to improve the DDIC refresh rate during the image display process The stability of the frequency can achieve the effect of improving the image display quality.

Optionally, when the historical display rate of the AP satisfies the display delay condition, the display delay operation is performed on the nth frame of image data, including:

In the case that the nth frame of image data is received within the first VFP duration corresponding to the first refresh frequency, the count value of the counter is obtained, and the count value of the counter is used to represent the consecutive times that the AP sends the display in advance;

When the count value of the counter is less than the count threshold, it is determined that the historical display rate of the AP satisfies the display delay condition, and the display delay operation is performed on the nth frame of image data based on the first VFP duration;

Update the count value of the counter.

Optionally, performing a display delay operation on the nth frame of image data based on the first VFP duration includes:

Based on the first VFP duration and the receiving position of the nth frame of image data, determine the delay duration of the display delay operation;

The display delay operation is performed on the nth frame of image data based on the delay time.

Optionally, when the display delay operation is completed, control the display screen to display the nth frame of image based on the nth frame of image data, including:

In the case that the waiting period after the scan of the n-1th frame reaches the first VFP duration, the display screen is controlled to display the nth frame of image based on the nth frame of image data.

Optionally, after obtaining the count value of the counter, the method further includes:

When the count value of the counter is greater than or equal to the count threshold, it is determined that the historical display rate of the AP does not meet the display delay condition, and the display screen is controlled to display the nth frame of image based on the nth frame of image data;

Update the count value of the counter.

Optionally, the method also includes:

In the case that the nth frame of image data is not received within the first VFP duration, and the nth frame of image data is received within the second VFP duration corresponding to the second refresh rate, the count value of the counter is reset, and the second refresh rate Less than the first refresh frequency, and the second VFP duration is longer than the first VFP duration.

Optionally, the method also includes:

In the case that the nth frame of image data is not received in the first VFP duration, and the nth frame of image data is not received in the second VFP duration, the count value of the counter is reset;

Based on the image data of the n-1th frame, the display screen is controlled to repeatedly display the n-1th frame of image.

Optionally, both the first VFP duration and the second VFP duration are integer multiples of the light emitting EM period.

Optionally, the first refresh rate matches the reference frame rate during the running of the foreground application.

Optionally, the method also includes:

Receive the control command sent by the AP, and the control command includes the base frame rate of the foreground application;

determining a first refresh rate based on a reference frame rate;

The first VFP duration is set based on the first refresh rate.

Optionally, the DDIC is applied to an OLED display.

In a possible implementation, the DDIC determines whether the AP has advanced display based on the receiving position of the image data (the receiving position is used to indicate the moment when the image data is received), and uses a counter to record the consecutive times of the AP's early display, Therefore, based on the consecutive times, the sporadic acceleration requests on the AP side are identified and filtered. The consecutive times of sending the display in advance is used to represent the number of frames that the AP transmits image data to the DDIC in advance. For example, when the consecutive times of sending the display in advance are 3 times , indicating that the image data of the last three frames of images are sent to the DDIC by the AP in advance. The following uses an exemplary embodiment for description.

Please refer to FIG. 5 , which shows a flowchart of an image display method according to another exemplary embodiment of the present application. The method includes:

Step 501, receiving the nth frame of image data sent by the AP, where n is a positive integer.

In a possible implementation manner, after receiving the nth frame of image data, the DDIC first determines whether the nth frame of image data is sent for display in advance based on the receiving position of the image data. Regarding the specific method of determining whether to send the display in advance, in a possible implementation, the DDIC determines the duration of the first vertical front porch (VFP) based on the first refresh frequency, and defines it within the duration of the first VFP The received image data belongs to the image data sent to the display ahead of time, and it is defined that the image data received outside the first VFP duration belongs to the image data not sent to the display ahead of time.

Schematically, the relationship between vertical synchronous signal (Vertical Synchronous Signal, Vsync), column-to-post delay interval (Vertical Back Porch, VBP), column-to-effective row number (Vertical active, Vact) and VFP is shown in Figure 6 , where Vact is the frame scanning process, and VFP is the waiting process after the frame scanning is completed.

Normally, the overall frame rate during application running remains stable. In order to reduce display power consumption while ensuring smooth display, the refresh frequency of DDIC needs to be consistent with the basic frame rate of the application as much as possible. Therefore, in this embodiment, the DDIC determines the first refresh rate that matches the reference frame rate during the running of the foreground application as the target refresh rate, and then uses the first VFP duration corresponding to the first refresh rate as a reference to determine whether the AP is ahead of schedule. Send display.

Wherein, the match between the target refresh rate and the reference frame rate means that the difference between the target refresh rate and the reference frame rate is less than a threshold (for example, the threshold is 5 Hz). Optionally, the target refresh rate is equal to the reference frame rate, or, the target refresh rate The frequency is slightly higher than the base frame rate, or the target refresh rate is slightly lower than the base frame rate.

In an exemplary example, when the base frame rate of the front-end application is 60 Hz, the DDIC determines that the first refresh frequency is 60 Hz.

In a possible implementation, the DDIC pre-determines the correspondence between different refresh frequencies and VFP durations based on the highest refresh rate of the display screen, wherein the VFP duration is an integer multiple of the EM period, that is, the VFP duration is The pulse duration of at least one light emitting pulse (Emisson pulse, EM pulse), and the period in which the display screen emits light once is the EM period. For example, when the EM frequency of the display is 360Hz, the duration of each EM cycle is 2.8ms.

In a schematic example, the corresponding relationship between the refresh frequency of the DDIC and the VFP is shown in Table 1.

Table I

刷新频率refresh rate	VFPVFP
90Hz90Hz	2.8ms(1个EM周期)2.8ms (1 EM cycle)
60Hz60Hz	8.3ms(3个EM周期)8.3ms (3 EM cycles)
30Hz30Hz	25ms(9个EM周期)25ms (9 EM cycles)

Combined with the data shown in Table 1, when the first refresh frequency is 60Hz, DDIC determines that the first VFP duration is 8.3ms.

Optionally, the DDIC detects whether the receiving position of the nth frame of image data is within the first VFP duration, and if it is within the first VFP duration, determines that the nth frame of image data is sent to display ahead of time, and executes the following step 502 .

Step 502, when the nth frame of image data is received within the first VFP duration corresponding to the first refresh frequency, obtain the count value of the counter, which is used to represent the consecutive times of the AP sending the display in advance.

When it is determined that the image data of the nth frame is sent for display in advance, DDIC needs to further determine whether the image data of the nth frame is scattered in advance based on the historical display rate of the AP before the image data of the nth frame. In some embodiments, if several consecutive frames of image data before the nth frame of image data are also sent for display in advance, the DDIC determines that the AP side continues to send for display in advance; , the DDIC determines that the AP side does not continue to send the display in advance, that is, the AP side sends the display in advance sporadically.

In this embodiment, the DDIC uses a counter to record the number of consecutive times that the AP sends the display in advance. When the nth frame of image data is sent to the display in advance, the DDIC determines whether the AP continues to send the display in advance based on the count value of the counter. Among them, the initial count value of the counter is 0.

Further, the DDIC detects whether the counting value of the counter reaches the counting threshold. If the counting threshold is not reached, the DDIC determines that the AP has not continuously sent the display in advance, and determines that the display delay condition is met, and performs the following steps 503 to 505; if the counting threshold is reached, The DDIC determines that the AP continues to send the display in advance, and determines that the display delay condition is not met, and executes the following steps 506 to 507.

Wherein, the counting threshold may be preset or user-defined, which is not limited in this embodiment.

In a schematic example, when the counting threshold is set to 2, it indicates that when the image data of 3 consecutive frames (including the current frame) are sent for display ahead of time, the DDIC determines that the AP continuously sends for display ahead of time.

Step 503, when the count value of the counter is less than the count threshold, determine that the historical display rate of the AP satisfies the display delay condition, and perform a display delay operation on the nth frame of image data based on the first VFP duration.

When the count value of the counter is less than the count threshold, the DDIC determines that the display delay condition is satisfied, and it is necessary to perform delayed display on the nth frame of image. In a possible implementation, in order to keep the refresh rate of the DDIC as stable as possible at the first refresh rate, the DDIC performs a display delay operation on the nth frame of image data based on the first VFP duration, so as to avoid When displayed within a certain period of time, the refresh rate suddenly increases.

In some embodiments, the DDIC determines the delay duration of the display delay operation based on the first VFP duration and the receiving position of the nth frame of image data, so as to perform the display delay operation on the nth frame of image data based on the delay duration, that is, the response If the waiting time after the scanning of the n-1th frame does not reach the first VFP duration, the DDIC will not control the display to display the nth frame image based on the nth frame image data, so as to prevent the nth frame image from being displayed in advance due to early display. Wherein, the delay time is the time when the DDIC delays scanning the nth frame, and the delay is the interval between the receiving position of the nth frame of image data and the position corresponding to the first VFP time length.

In a schematic example, when DDIC receives the nth frame of image data in the second EM cycle, and DDIC determines that the first VFP duration is 3 EM cycles, DDIC determines that the nth frame of image needs to be delayed by 1 Displayed after the EM cycle; when DDIC receives the nth frame of image data in the first EM cycle, and DDIC determines that the first VFP duration is 3 EM cycles, DDIC determines that the nth frame of image needs to be delayed by 2 EM cycles show. Schematically, as shown in Figure 7, when the basic frame rate of the front-end application is 60FPS, the DDIC determines that the first VFP duration is 3 EM cycles, so as to detect whether to receive within 3 EM cycles after the image scanning of the current frame is completed. to the new image data sent by the AP. Since the DDIC receives the sixth frame of image data within the first VFP duration (at the second EM cycle), the DDIC determines that the sixth frame of image data is sent to display ahead of time, and obtains the current count value of the counter as 0 (the first to the first None of the 5 frames of image data was sent to display in advance). Since the current count value is less than the count threshold (2), the DDIC determines that the display delay condition is satisfied, and determines that a display delay operation of 1 EM cycle is required for the sixth frame of image data.

Step 504, updating the count value of the counter.

In a possible implementation manner, after the detection of the display delay condition is completed, the DDIC needs to update the count value of the counter, that is, perform an operation of adding one to the current count value.

Schematically, as shown in FIG. 7 , the DDIC updates the count value of the counter from 0 to 1.

Of course, in other possible implementations, when the nth frame of image data is received within the first VFP duration corresponding to the first refresh rate, the DDIC can also update the count value of the counter first, and then perform display delay condition detection (Compared with the scheme of first detecting and then updating the count value, under the scheme of first updating the count value and then detecting, the count threshold needs to be increased by 1), and this embodiment will not be described in detail here.

Step 505 , when the waiting time after the scanning of the n-1th frame reaches the first VFP duration, control the display screen to display the nth frame of image based on the nth frame of image data.

When the waiting time after the scanning of the n-1th frame reaches the first VFP duration, the DDIC controls the display screen to display images based on the image data of the nth frame, so that the refresh rate of the DDIC is stabilized at the first refresh rate.

Schematically, as shown in Figure 7, if the display delay mechanism is not introduced, if the DDIC performs image scanning immediately after receiving the image data, when the AP sends the sixth frame of image data, there is a temporary delay in sending the display , the refresh rate of DDIC will suddenly rise to 72Hz; when there is a delay of 1 EM cycle when the AP sends the seventh frame of image data, the refresh rate of DDIC will suddenly drop to 45Hz, resulting in a large-scale jump in the refresh rate; When the display delay mechanism is introduced, when the DDIC receives the sixth frame of image data sent by the AP in advance, because the count value of the counter does not reach the count threshold, the DDIC does not directly scan the image, but performs an EM The cycle display delay operation keeps the refresh rate at 60Hz; when the AP sends the seventh frame of image data with a delay of 1 EM cycle, the refresh rate of the DDIC drops from 60Hz to 51Hz, and the stability of the refresh rate is significantly improved.

Step 506, when the count value of the counter is greater than or equal to the count threshold, determine that the historical display rate of the AP does not meet the display delay condition, and control the display screen to display the nth frame of image based on the nth frame of image data.

When the count value of the counter reaches the count threshold, it indicates that the AP has continuously sent the display in advance in the recent period, that is, there is a continuous acceleration request, and the DDIC determines that the display delay condition is not met, so the image scan is performed based on the nth frame of image data, so that the DDIC The refresh rate is consistent with the display rate of the AP.

Schematically, as shown in Figure 8, when receiving the fourth frame of image data sent by the AP in advance, since the count value of the counter is 0<count threshold 2, the DDIC determines that the display delay condition is met, and the fourth frame of image data The data is displayed with a delay operation (delayed by 2 EM cycles); when receiving the fifth frame of image data sent by the AP in advance, since the count value 1 of the counter is less than the count threshold 2, the DDIC determines that the display delay condition is satisfied, and the 5 frames of image data are displayed with a delay operation (delayed by 1 EM cycle); when receiving the 6th frame of image data sent by the AP in advance, since the count value of the counter is 2 = count threshold 2, DDIC determines that the display delay is not satisfied The condition is that the display delay is not performed on the image data of the sixth frame, but the image scan is performed immediately.

Step 507, update the count value of the counter.

In a possible implementation manner, when the display delay condition is not satisfied, the DDIC also needs to update the count value of the counter. Schematically, as shown in FIG. 8 , after receiving the sixth frame of image data sent by the AP for display in advance, the DDIC updates the count value of the counter to 3.

In this embodiment, the DDIC determines whether the AP has an early display based on the positional relationship between the receiving position of the image data and the first VFP duration, and uses a counter to record the consecutive times of the AP's early display, so as to identify and Filter the sporadic acceleration requests on the AP side to avoid fluctuations in the refresh frequency of the DDIC caused by sporadic acceleration requests; and, using the counter to realize the above display delay judgment, the implementation process is simple, and it helps to improve the timeliness of the judgment of the display delay timing.

Because the first refresh rate matches the base frame rate of the foreground application, and the base frame rate of different foreground applications may be different, for example, the base frame rate of a game application is 60FPS, while the base frame rate of an instant messaging application is 45FPS. To enable the refresh frequency of the DDIC to be adapted to the currently running foreground application, in a possible implementation manner, when the AP detects that the foreground application is running, it sends a control instruction to the AP that includes the reference frame rate corresponding to the foreground application. Correspondingly, after receiving the control instruction sent by the AP, the DDIC determines the first refresh frequency based on the reference frame rate in the control instruction, and then sets the first VFP duration based on the first refresh frequency. Optionally, the DDIC determines the first refresh frequency based on the reference frame rate, so as to determine the first VFP duration based on the correspondence between the refresh frequency and the VFP duration.

In a possible situation, when there is a large delay in sending the display on the AP side, the DDIC needs to rescan (repeating) the current display image, and continue to output the TE signal after rescanning, so that the AP can detect the TE signal Send image data to DDIC at the same time. In a possible implementation, in addition to determining whether the AP sends the display in advance based on the first VFP duration corresponding to the first refresh frequency, the DDIC also needs to determine whether the AP has an excessive Amplitude of display delay.

Optionally, if the nth frame of image data is not received within the first VFP duration and the nth frame of image data is received within the second VFP duration corresponding to the second refresh frequency, DDIC determines the nth frame of image data There is a slight delay. Correspondingly, if the continuous advance display on the AP side before the nth frame of image data is interrupted, the count value of the counter is reset. For example, DDIC resets the count value of the counter to 0.

Wherein, the second refresh frequency is lower than the first refresh frequency, so the second VFP duration corresponding to the second refresh rate is longer than the first VFP duration corresponding to the first refresh rate, and the second VFP duration is also an integer multiple of the EM cycle. In an illustrative example, when the first refresh frequency is 60 Hz, the second refresh frequency is 30 Hz, and the second VFP duration is a duration corresponding to 9 EM cycles.

Schematically, as shown in Figure 7, when the display delay mechanism is introduced, the DDIC receives the seventh frame of image data sent by the AP outside the first VFP duration (at the seventh EM cycle), and the count value of the counter reset to 0; as shown in Figure 8, the DDIC receives the 7th frame of image data sent by the AP outside the first VFP duration (at the 6th EM cycle), thereby resetting the count value of the counter to 0.

Optionally, when the nth frame of image data is not received within the second VFP duration, the DDIC resets the count value of the counter, and controls the display screen to repeatedly display the n-1th frame of image based on the n-1th frame of image data.

For example, as shown in Figure 9, when the DDIC receives the fourth frame of image data sent by the AP within the first VFP duration corresponding to the first refresh frequency of 60 Hz, and still receives the fourth frame of image data during the second VFP duration corresponding to the second refresh frequency of 30 Hz. The 4th frame of image data sent by the AP has not been received, and the DDIC determines that there is an excessive display delay on the AP side, thereby resetting the count value of the counter, and rescanning the 3rd frame of image based on the 3rd frame of image data, wherein, after rescanning During the period of the third image frame, the DDIC continues to output the TE signal, so that the AP can transmit the prepared fourth frame image data when the TE signal is detected.

In a schematic example, the process of the DDIC controlling the display screen to display images is shown in FIG. 10 .

Step 1001, detecting whether the image data sent by the AP is received. If image data is not received, execute step 1002; if image data is received, execute step 1004.

Optionally, the DDIC detects whether image data is received at the same frequency as the EM frequency (the image data sent by the AP is marked with 0x2C).

Step 1002, detecting whether Temp_Extend_Pulse (temporary extended pulse) reaches ADFR_Max_Extend_Pulse (ADFR extended pulse upper limit). If ADFR_Max_Extend_Pulse is reached, step 1008 is performed; if ADFR_Max_Extend_Pulse is not reached, step 1003 is performed.

Wherein, the Temp_Extend_Pulse is the number of EM cycles passed after image scanning, ADFR_Max_Extend_Pulse is the second VFP duration in the above embodiment, and the display frequency conversion technology automatically implemented by DDIC within the frequency conversion range is called Adaptive Dynamic Frequency Conversion (Adaptive Dynamic Frequency Conversion) Dynamic Frame Rate, ADFR).

Step 1003, add one to Temp_Extend_Pulse.

Step 1004, detecting whether Temp_Extend_Pulse is smaller than ADFR_Delay_Extend_Pulse_Threshold (ADFR extended pulse threshold). If less, execute step 1005; if greater than or equal, execute step 1008.

Wherein, the ADFR_Delay_Extend_Pulse_Threshold is the first VFP duration in the above embodiment.

Step 1005, detecting whether Temp_Delay_Count (temporary delay count) is smaller than ADFR_Delay_Count_Threshold (ADFR delay count threshold). If less, execute step 1006; if greater than or equal to, execute step 1009.

Wherein, Temp_Delay_Count is the count value of the counter in the above embodiment, and ADFR_Delay_Count_Threshold is the count threshold.

Step 1006, add one to Temp_Delay_Count.

Step 1007, delay Temp_Extend_Pulse to ADFR_Delay_Extend_Pulse_Threshold.

In this step, the DDIC performs a display delay operation when the display delay condition is satisfied, and scans the image until the waiting time after image scanning reaches the first VFP time length.

Step 1008, reset Temp_Delay_Count.

Step 1009, controlling the display screen to display images.

Among them, when Temp_Extend_Pulse reaches ADFR_Max_Extend_Pulse, DDIC controls the display to redisplay the image; when Temp_Delay_Count is greater than or equal to ADFR_Delay_Count_Threshold, DDIC controls to display a new image frame.

In some embodiments, the method provided by the embodiment of the present application is applied to a mobile terminal, that is, the DDIC of the OLED display screen in the mobile terminal executes the above image display method. Since the mobile terminal is usually powered by a battery, and the power of the battery is limited (it is relatively sensitive to power consumption), after applying the method provided by the embodiment of the present application to the mobile terminal, it can reduce the display quality of the mobile terminal while improving the display quality of the mobile terminal. power consumption. Wherein, the mobile terminal may include a smart phone, a tablet computer, a wearable device (such as a smart watch), a portable personal computer, etc., and the embodiment of the present application does not limit the specific type of the mobile terminal.

Certainly, the method provided in the embodiment of the present application may also be used in other non-battery-powered terminals, such as a TV, a monitor, or a personal computer, which is not limited in the embodiment of the present application.

The embodiment of the present application also provides a DDIC, the DDIC is applied to a display screen, and the DDIC is used for:

Optionally, the DDIC is used for:

When the count value of the counter is less than the count threshold, it is determined that the historical display rate of the AP satisfies the display delay condition, and the display delay is performed on the nth frame of image data based on the first VFP duration. operate;

The count value of the counter is updated.

Optionally, the DDIC is used for:

The display delay operation is performed on the nth frame of image data based on the delay time length.

Optionally, the DDIC is used for:

In a case where the waiting time after the scanning of the n-1th frame is completed reaches the first VFP duration, controlling the display screen to display the nth frame of image based on the nth frame of image data.

Optionally, the DDIC is also used for:

When the count value of the counter is greater than or equal to the count threshold, it is determined that the historical display rate of the AP does not meet the display delay condition, and the display screen is controlled based on the nth frame of image data to display the Describe the nth frame image;

The count value of the counter is updated.

Optionally, the DDIC is also used for:

When the nth frame of image data is not received within the first VFP duration and the nth frame of image data is received within the second VFP duration corresponding to the second refresh frequency, reset the counter is a count value, the second refresh rate is less than the first refresh rate, and the second VFP duration is greater than the first VFP duration.

Optionally, the DDIC is also used for:

In the case that the nth frame of image data is not received within the first VFP duration, and the nth frame of image data is not received within the second VFP duration, the count of the counter is reset value;

The display screen is controlled to repeatedly display the n-1th frame of image based on the n-1th frame of image data.

Optionally, both the first VFP duration and the second VFP duration are integer multiples of an EM period of light emission.

Optionally, the first refresh rate matches a reference frame rate during the running of the foreground application.

Optionally, the DDIC is also used for:

receiving a control instruction sent by the AP, where the control instruction includes the reference frame rate of the foreground application;

determining the first refresh rate based on the reference frame rate;

The first VFP duration is set based on the first refresh frequency.

Optionally, the DDIC is applied to an OLED display.

For the detailed process of implementing the image display method by the above DDIC, reference may be made to the above method embodiments, and details will not be repeated here in this embodiment.

In addition, the embodiment of the present application also provides a display screen module, the display screen module includes a display screen and a DDIC, the DDIC is used to drive the display screen, and the DDIC is used to implement the image display method provided by the above method embodiments.

Please refer to FIG. 11 , which shows a structural block diagram of a terminal 1100 provided by an exemplary embodiment of the present application. The terminal 1100 may be a smart phone, a tablet computer, a notebook computer, and the like. The terminal 1100 in this application may include one or more of the following components: a processor 1110 , a memory 1120 , and a display screen module 1130 .

The processor 1110 may include one or more processing cores, and the processor 1110 may be the AP described in the foregoing embodiments. The processor 1110 uses various interfaces and lines to connect various parts of the entire terminal 1100, and executes the terminal by running or executing instructions, programs, code sets or instruction sets stored in the memory 1120, and calling data stored in the memory 1120. 1100 various functions and process data. Optionally, the processor 1110 may adopt at least one of Digital Signal Processing (Digital Signal Processing, DSP), Field-Programmable Gate Array (Field-Programmable Gate Array, FPGA), and Programmable Logic Array (Programmable Logic Array, PLA). implemented in the form of hardware. The processor 1110 can integrate one or more of a central processing unit (Central Processing Unit, CPU), an image processor (Graphics Processing Unit, GPU), a neural network processor (Neural-network Processing Unit, NPU) and a modem, etc. The combination. Among them, the CPU mainly handles the operating system, user interface and application programs, etc.; the GPU is used for rendering and drawing the content that the touch display module 1130 needs to display; the NPU is used for realizing artificial intelligence (Artificial Intelligence, AI) functions; the modem Used to handle wireless communications. It can be understood that, the above-mentioned modem may not be integrated into the processor 1110, but may be realized by a single chip.

The memory 1120 may include a random access memory (Random Access Memory, RAM), and may also include a read-only memory (Read-Only Memory, ROM). Optionally, the memory 1120 includes a non-transitory computer-readable storage medium. The memory 1120 may be used to store instructions, programs, codes, sets of codes, or sets of instructions. The memory 1120 may include a program storage area and a data storage area, wherein the program storage area may store instructions for implementing an operating system, instructions for at least one function (such as a touch function, a sound playback function, an image playback function, etc.), Instructions and the like for implementing various method embodiments of the present application; the storage data area may store data created according to the use of the terminal 1100 (such as audio data, phone book) and the like.

The display screen module 1130 is a display component for displaying images, and is usually arranged on the front panel of the terminal 1100 . The display module 1130 can be designed as a full screen, a curved screen, a special-shaped screen, a double-sided screen or a folding screen. The display screen module 1130 can also be designed as a combination of a full screen and a curved screen, or a combination of a special-shaped screen and a curved screen, which is not limited in this embodiment.

In the embodiment of the present application, the display screen module 1130 includes a DDIC 1131 and a display screen 1132 (panel). Wherein, the display screen 1132 may be an OLED display screen, which may be a low temperature polysilicon (Low Temperature Poly-Silicon, LTPS) AMOLED display screen or a low temperature polycrystalline oxide (Low Temperature Polycrystalline Oxide, LTPO) AMOLED display screen.

The DDIC 1131 is used to drive the display screen 1132 to display images, so as to realize the image display methods provided by the above-mentioned embodiments. In addition, the DDIC 1131 is connected to the processor 1110 through a MIPI interface, and is used to receive image data and instructions issued by the processor 1110.

In a possible implementation manner, the display screen module 1130 also has a touch function, through which a user can use any suitable object such as a finger or a touch pen to perform touch operations on the display screen module 1130 .

In addition, those skilled in the art can understand that the structure of the terminal 1100 shown in the above drawings does not constitute a limitation on the terminal 1100, and the terminal may include more or less components than those shown in the figure, or combine some components, or different component arrangements. For example, the terminal 1100 also includes components such as a microphone, a speaker, a radio frequency circuit, an input unit, a sensor, an audio circuit, a wireless fidelity (Wireless Fidelity, WiFi) module, a power supply, and a bluetooth module, which will not be repeated here.

Those skilled in the art should be aware that, in the foregoing one or more examples, the functions described in the embodiments of the present application may be implemented by hardware, software, firmware or any combination thereof. When implemented in software, the functions may be stored on or transmitted over as one or more instructions or code on a computer-readable medium. Computer-readable media includes both computer storage media and communication media including any medium that facilitates transfer of a computer program from one place to another. A storage media may be any available media that can be accessed by a general purpose or special purpose computer.

The above are only optional embodiments of the application, and are not intended to limit the application. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the application shall be included in the protection of the application. within range.

Claims

An image display method for a display driver chip DDIC of a display screen, the method comprising:

Receive the nth frame of image data sent by the application processor AP, where n is a positive integer;

When the historical display rate of the AP satisfies the display delay condition, perform a display delay operation on the nth frame of image data, and the display delay operation is used to delay displaying the nth frame of image;

When the display delay operation is completed, the display screen is controlled to display the nth frame of image based on the nth frame of image data.
The method according to claim 1, wherein the performing a display delay operation on the nth frame of image data when the historical display rate of the AP satisfies the display delay condition includes:

When the first column corresponding to the first refresh frequency receives the nth frame of image data within the forward delay interval VFP duration, the count value of the counter is obtained, and the count value of the counter is used to indicate that the AP sends in advance Displayed consecutive times;

When the count value of the counter is less than the count threshold, it is determined that the historical display rate of the AP satisfies the display delay condition, and the display delay is performed on the nth frame of image data based on the first VFP duration. operate;

The count value of the counter is updated.
The method according to claim 2, wherein said performing the display delay operation on the nth frame of image data based on the first VFP duration comprises:

Based on the first VFP duration and the receiving position of the nth frame of image data, determine the delay duration of the display delay operation;

The display delay operation is performed on the nth frame of image data based on the delay time length.
The method according to claim 2, wherein when the display delay operation is completed, controlling the display screen to display the nth frame of image based on the nth frame of image data comprises:

In a case where the waiting time after the scanning of the n-1th frame is completed reaches the first VFP duration, controlling the display screen to display the nth frame of image based on the nth frame of image data.
The method according to claim 2, wherein, after acquiring the count value of the counter, the method further comprises:

When the count value of the counter is greater than or equal to the count threshold, it is determined that the historical display rate of the AP does not meet the display delay condition, and the display screen is controlled based on the nth frame of image data to display the Describe the nth frame image;

The count value of the counter is updated.
The method according to claim 2, wherein the method further comprises:

When the nth frame of image data is not received within the first VFP duration and the nth frame of image data is received within the second VFP duration corresponding to the second refresh frequency, reset the counter is a count value, the second refresh rate is less than the first refresh rate, and the second VFP duration is greater than the first VFP duration.
The method according to claim 6, wherein the method further comprises:

In the case that the nth frame of image data is not received within the first VFP duration, and the nth frame of image data is not received within the second VFP duration, the count of the counter is reset value;

The display screen is controlled to repeatedly display the n-1th frame of image based on the n-1th frame of image data.
The method according to claim 6, wherein both the first VFP duration and the second VFP duration are integer multiples of an EM period of light emission.
The method according to claim 2, wherein the first refresh rate matches a reference frame rate during the running of the foreground application.
The method according to claim 9, wherein the method further comprises:

receiving a control instruction sent by the AP, where the control instruction includes the reference frame rate of the foreground application;

determining the first refresh rate based on the reference frame rate;

The first VFP duration is set based on the first refresh frequency.
The method according to any one of claims 1 to 10, wherein the DDIC is applied to an organic light emitting diode (OLED) display.
A display driver chip DDIC, the DDIC chip is applied to a display screen, and the DDIC is used for:

Receive the nth frame of image data sent by the application processor AP, where n is a positive integer;

When the historical display rate of the AP satisfies the display delay condition, perform a display delay operation on the nth frame of image data, and the display delay operation is used to delay displaying the nth frame of image;

When the display delay operation is completed, the display screen is controlled to display the nth frame of image based on the nth frame of image data.
The DDIC according to claim 12, wherein the DDIC is used for:

When the first column corresponding to the first refresh frequency receives the nth frame of image data within the forward delay interval VFP duration, the count value of the counter is obtained, and the count value of the counter is used to indicate that the AP sends in advance Displayed consecutive times;

When the count value of the counter is less than the count threshold, it is determined that the historical display rate of the AP satisfies the display delay condition, and the display delay is performed on the nth frame of image data based on the first VFP duration. operate;

The count value of the counter is updated.
The DDIC according to claim 13, wherein the DDIC is used for:

Based on the first VFP duration and the receiving position of the nth frame of image data, determine the delay duration of the display delay operation;

The display delay operation is performed on the nth frame of image data based on the delay time length.
The DDIC according to claim 13, wherein the DDIC is used for:

In a case where the waiting time after the scanning of the n-1th frame is completed reaches the first VFP duration, controlling the display screen to display the nth frame of image based on the nth frame of image data.
The DDIC according to claim 13, wherein the DDIC is also used for:

When the count value of the counter is greater than or equal to the count threshold, it is determined that the historical display rate of the AP does not meet the display delay condition, and the display screen is controlled based on the nth frame of image data to display the Describe the nth frame image;

The count value of the counter is updated.
The DDIC according to claim 13, wherein the DDIC is also used for:

When the nth frame of image data is not received within the first VFP duration and the nth frame of image data is received within the second VFP duration corresponding to the second refresh frequency, reset the counter is a count value, the second refresh rate is less than the first refresh rate, and the second VFP duration is greater than the first VFP duration.
The DDIC according to claim 17, wherein the DDIC is also used for:

In the case that the nth frame of image data is not received within the first VFP duration, and the nth frame of image data is not received within the second VFP duration, the count of the counter is reset value;

The display screen is controlled to repeatedly display the n-1th frame of image based on the n-1th frame of image data.
The DDIC according to claim 17, wherein both the first VFP duration and the second VFP duration are integer multiples of an EM period of light emission.
The DDIC according to claim 13, wherein the first refresh rate matches a reference frame rate during the running of the foreground application.
The DDIC according to claim 20, wherein the DDIC is also used for:

receiving a control instruction sent by the AP, where the control instruction includes the reference frame rate of the foreground application;

determining the first refresh rate based on the reference frame rate;

The first VFP duration is set based on the first refresh frequency.
The DDIC according to any one of claims 12 to 21, wherein the DDIC is applied to an organic light emitting diode (OLED) display.
A display screen module, the display screen module includes a display screen and a display driver chip DDIC, the DDIC is used to drive the display screen, and the DDIC is used to realize any one of claims 1 to 11 Image display method.
A terminal, wherein the terminal includes an application processor AP, a display screen and a display driver chip DDIC, the AP and the DDIC are connected through a mobile industry processor interface MIPI, and the DDIC is used to implement the The image display method described in any one of 11 to 11.