CN117850729A

CN117850729A - Picture processing method and device, electronic equipment and readable storage medium

Info

Publication number: CN117850729A
Application number: CN202410031145.1A
Authority: CN
Inventors: 黎宏付; 张彪
Original assignee: Vivo Mobile Communication Co Ltd
Current assignee: Vivo Mobile Communication Co Ltd
Priority date: 2024-01-09
Filing date: 2024-01-09
Publication date: 2024-04-09

Abstract

The application discloses a picture processing method, a picture processing device, electronic equipment and a readable storage medium, and belongs to the technical field of image data processing. The picture processing method provided by the embodiment of the application comprises the following steps: the electronic equipment acquires frequency parameters of a display module of the electronic equipment touched by a user; under the condition that the frequency parameter is larger than the preset frequency parameter, the electronic equipment processes the display picture through the target display card by using a first mode; or under the condition that the frequency parameter is smaller than the preset frequency parameter, the electronic equipment processes the display picture by using a second mode through the target display card; the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

Description

Picture processing method and device, electronic equipment and readable storage medium

Technical Field

The application belongs to the technical field of image data processing, and particularly relates to a picture processing method, a picture processing device, electronic equipment and a readable storage medium.

Background

Currently, an independent video card of an electronic device is configured with a plurality of modes for processing a frame of a display screen, and when the independent video card uses different modes, delays of outputting the frame are different, and image qualities of the frame are different, so that when the independent video card uses different modes, touch response delays and image qualities of the display screen of the electronic device are also different. Therefore, the electronic equipment can control the independent display card to process the display picture by using a certain mode, so that the electronic equipment can display the display picture with corresponding touch response delay and picture quality.

However, after the independent graphics card processes the display screen in the certain mode, a situation may occur that the touch response delay of the display screen is not matched with the touch response delay required by the user, so that the display screen may not respond to the touch operation of the user in time; alternatively, the image quality of the display screen may not match the image quality required by the user, and thus the image quality of the display screen may not meet the user requirement. In summary, the current electronic device cannot adaptively adjust the touch response delay and the image quality of the display screen, so that the display screen of the electronic device cannot meet the use requirement of the user.

Disclosure of Invention

An object of the embodiments of the present application is to provide a method, an apparatus, an electronic device, and a readable storage medium for processing a picture, which can solve the problem that the electronic device cannot adaptively adjust the touch response delay and the picture quality of a display picture.

In a first aspect, an embodiment of the present application provides a method for processing a picture, where the method includes: the electronic equipment acquires frequency parameters of a display module of the electronic equipment touched by a user; under the condition that the frequency parameter is larger than the preset frequency parameter, the electronic equipment processes the display picture through the target display card by using a first mode; or under the condition that the frequency parameter is smaller than the preset frequency parameter, the electronic equipment processes the display picture by using a second mode through the target display card; the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

In a second aspect, embodiments of the present application provide an electronic device, including: a system-on-chip; the system comprises a target display card, a system-level chip and a control unit, wherein the target display card is in communication connection with the system-level chip and is internally provided with an interrupt timer; the display module is in communication connection with the target display card, a target interface of the display module is also in communication connection with the interrupt timer and the system-level chip, and the display module is used for sending interrupt signals to the interrupt timer and the system-level chip through the target interface under the condition that a user touches the display module. The interrupt counter is used for determining the frequency parameter of a display module of the electronic equipment touched by a user according to the interrupt signal; the target display card is used for processing a display picture output by the system-in-chip by using a first mode under the condition that the frequency parameter is larger than a preset frequency parameter; or under the condition that the frequency parameter is smaller than the preset frequency parameter, processing the display picture output by the system-in-chip by using the second mode.

In a third aspect, an embodiment of the present application provides a picture processing apparatus, including: the acquisition module is used for acquiring the frequency parameter of the display module of the user touch screen processing device. The processing module is used for processing the display picture by using the first mode through the target display card under the condition that the frequency parameter acquired by the acquisition module is larger than the preset frequency parameter; or under the condition that the frequency parameter is smaller than the preset frequency parameter, the target display card processes the display picture by using the second mode. The time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

In a fourth aspect, embodiments of the present application provide an electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the method as described in the first aspect.

In a fifth aspect, embodiments of the present application provide a readable storage medium having stored thereon a program or instructions which when executed by a processor implement the steps of the method according to the first aspect.

In a sixth aspect, embodiments of the present application provide a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and where the processor is configured to execute a program or instructions to implement the steps of the method according to the first aspect.

In a seventh aspect, embodiments of the present application provide a computer program product stored in a storage medium, the program product being executed by at least one processor to implement the steps of the method as described in the first aspect.

In the embodiment of the application, the electronic device may acquire the frequency parameter of the display module of the electronic device touched by the user, and then process the display screen corresponding to the first mode through the target display card when the frequency parameter is greater than the preset frequency parameter, or process the display screen corresponding to the second mode through the target display card when the frequency parameter is less than the preset frequency parameter; the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode. The electronic device can acquire the frequency parameter of the display module of the electronic device touched by the user firstly, then under the condition that the frequency parameter is larger than the preset frequency parameter, namely under the condition that the user frequently performs touch operation on the display module, the touch response delay which is possibly lower in requirement of the user is determined, and the target display card uses the first mode with lower time delay of the output picture frame, so that the target display card can rapidly output the picture frame, the electronic device can rapidly update the displayed picture frame, the display picture is rapidly updated, and the touch response delay of the display picture of the electronic device is further reduced, therefore, the probability that the display picture cannot timely respond to the touch operation of the user can be reduced; or under the condition that the frequency parameter is smaller than the preset frequency parameter, namely, the condition that the user does not frequently perform touch operation on the display module, determining that the user may not need lower touch response delay, and using the second mode with higher time delay of the output picture frame by the target display card to enable the target display card to have more time to process the picture frame of the display picture, so that the picture quality of the picture frame output by the target display card is higher, and further, the picture quality of the display picture of the electronic equipment can be improved. In summary, the electronic device in the present application can adaptively adjust the touch response delay and the image quality of the display screen according to the frequency parameter, so that the probability that the image quality of the display screen cannot meet the user requirement can be reduced.

Drawings

FIG. 1 is a schematic diagram of a system architecture of a stand-alone graphics card in the related art;

fig. 2 is a schematic diagram of a frame output timing of a normal interpolation mode in the related art;

FIG. 3 is a diagram showing a frame output timing of a low-latency frame inserting mode in the related art;

FIG. 4 is a schematic flow chart of a method for processing a frame according to an embodiment of the present disclosure;

fig. 5 is a schematic diagram of a system architecture of a target graphics card according to an embodiment of the present application;

FIG. 6 is a second flowchart of a frame processing method according to an embodiment of the present disclosure;

FIG. 7 is a third flowchart of a method for processing a frame according to the embodiment of the present disclosure;

FIG. 8 is a schematic diagram of a frame output timing of a frame switched from a second mode to a first mode according to an embodiment of the present disclosure;

FIG. 9 is a flowchart of a frame processing method according to an embodiment of the present disclosure;

fig. 10 is a schematic diagram of a system architecture of an electronic device according to an embodiment of the present application;

fig. 11 is a schematic structural diagram of a picture processing apparatus according to an embodiment of the present application;

fig. 12 is a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application;

fig. 13 is a second schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed Description

Technical solutions in the embodiments of the present application will be clearly described below with reference to the drawings in the embodiments of the present application, and it is apparent that the described embodiments are some embodiments of the present application, but not all embodiments. All other embodiments obtained by a person of ordinary skill in the art based on the embodiments in the present application are within the scope of the protection of the present application.

Terms related to embodiments of the present application will be described below.

1. Independent display card

Currently, as shown in fig. 1, a System architecture of an electronic device using an independent graphics card is generally shown, where the independent graphics card is disposed between a System on a Chip (SoC) and a display module (Liquid Crystal DisplayModule, LCM) of the electronic device. The power of the independent display card, the control signal, the data and the frame rate synchronous signals are all provided and controlled by the SoC.

When the processing of the display enhancement (frame insertion, super division, noise reduction, color enhancement, color calibration and the like) with the single display is needed, the data can be output after being processed by the single display internal functional module; when the processing is not needed, the processing is directly output to the display screen through the independent internal channel.

The SoC generally includes a processor core, a digital signal processor, a memory module, a communication interface, a power management module, a radio frequency front end, and other modules. The SoC may be connected to the complementary metal oxide semiconductor camera module (Complementary Metal Oxide Semiconductor CameraModule, CCM) through a camera serial interface (Camera serial interface Receiver, CSI) module, the SoC may be connected to the Battery through a handset power management chip/module (PowerManagement Integrated Circuit, PMIC) that may also be connected to a power supply (power) module of an independent graphics card to supply power to the independent graphics card, where the PMIC includes a Battery management chip, a single-display power management chip, and other module power management chips/modules; the display serial interface (Displayserial Interface Transmitter, DSI) module of the SoC may be connected to the display serial interface receive (Displayserial Interface Receiver, DSI-RX) module of the independent graphics card, such that the SoC may send image frames to the DSI-RX module of the independent graphics card using the mobile industry processor interface (Mobile Industry Processor Interface, MIPI) protocol through the DSI module; the SoC may be connected to a GPIO module of an independent graphics card through a general purpose input output (General Purpose Input Output, GPIO) module, so that the SoC may transmit or receive a frame rate synchronization signal (TE) to or from the GPIO of the independent graphics card through the GPIO module.

The independent display card can comprise a functional module (Intellectual Property, IP), and the independent display card can be connected with the LCM through a DSI-TX module of the independent display card. In this way, in the case of receiving an image frame, the DSI-RX module of the independent video card may send the image frame to the IP so that the IP may process the image frame and send the image frame to the DSI-TX module of the independent video card, or the DSI-RX module of the independent video card may directly send the image frame to the DSI-TX module of the independent video card so that the DSI-TX module of the independent video card may send the image frame to the LCM using the MIPI protocol, so that the LCM may display the image frame.

2. Frame inserting mode of independent display card

In general, the frame insertion mode of the independent graphics card may include: a normal frame insertion mode and a low-latency frame insertion mode.

The frame inserting flow of the common frame inserting mode is specifically as follows:

assuming that the SoC outputs each frame (e.g., frame a to D) of the display screen to the independent video card at a frame rate of 30 Hz, for example, the SoC may output each frame of the display screen to the independent video card at time t0 to t3, and a time interval between every two adjacent times of the time t0 to t3 is 33.3 ms, so when the electronic device determines to process the display screen using the normal frame inserting mode, the electronic device may first determine a frame rate (e.g., 60 Hz) corresponding to the normal frame inserting mode, and determine a time when the independent video card transmits the image frame to the display module, e.g., time t1 to t4 and time t1' to t3', where the time t1' to t3' is determined based on the frame rate 60Hz, as shown in fig. 2, the SoC may output the frame a to the independent video card at time t0, and then the independent video card may output the frame B to the independent video card at time t1, and the independent video card may generate the frame B based on the frame a and the frame b+the frame B (e.g., the frame b+b) and output the frame a+the frame to the display module at time t1 and the frame b+2 ' to the display module at the time t 1. Thus, the SoC may output the frame C to the independent graphics card at time t2, so that the independent graphics card may receive the frame C, and at this time, the independent graphics card may generate the frame (b+c)/2 based on the frame B and the frame C, and output the frame B to the display module at time t2, and output the frame (b+c)/2 to the display module at time t 2'. And so on until the picture frame D is output to the display module.

The frame inserting flow of the low-delay frame inserting mode is specifically as follows:

assuming that the SoC outputs each frame (e.g., frame a to D) of the display screen to the independent display card at a frame rate of 30Hz, for example, the SoC may output each frame of the display screen to the independent display card at time t0 to t3, the time interval between every two adjacent times of time t0 to t3 is 33.3ms, so that in the case where the electronic device determines to process the display screen using the normal frame inserting mode, the electronic device may first determine the frame rate (e.g., 60 Hz) corresponding to the normal frame inserting mode, and determine the time when the independent display card sends the image frame to the display module, e.g., time t1 to t4 and time t1 'to t3', where the time t1 'to t3' is determined based on the frame rate of 60Hz, as shown in fig. 3, the SoC may output the frame a to the independent display card at time t0, and generate the frame inserting frame a 'directly based on the frame a and the history motion vector, and output the frame a to the display module at time t0, and output the frame a to the display module at the time t 0'; therefore, the SoC can output the picture frame B to the independent display card at the time t1, so that the independent display card can receive the picture frame B, directly generate an inserting frame picture frame B ' based on the picture frame B and the historical motion vector, output the picture frame B ' to the display module at the time t1', and the like until the picture frame D is output to the display module.

3. Other terms

The terms first, second and the like in the description and in the claims, are used for distinguishing between similar objects and not necessarily for describing a particular sequential or chronological order. It is to be understood that the data so used may be interchanged, as appropriate, such that embodiments of the present application may be implemented in sequences other than those illustrated or described herein, and that the objects identified by "first," "second," etc. are generally of a type and not limited to the number of objects, e.g., the first object may be one or more. Furthermore, in the description and claims, "and/or" means at least one of the connected objects, and the character "/", generally means that the associated object is an "or" relationship.

The terms "at least one," "at least one," and the like in the description and in the claims of the present application mean that they encompass any one, any two, or a combination of two or more of the objects. For example, at least one of a, b, c (item) may represent: "a", "b", "c", "a and b", "a and c", "b and c" and "a, b and c", wherein a, b, c may be single or plural. Similarly, the term "at least two" means two or more, and the meaning of the expression is similar to the term "at least one".

The method, the device, the electronic equipment and the readable storage medium for processing the picture provided by the embodiment of the application are described in detail below by means of specific embodiments and application scenes thereof with reference to the accompanying drawings.

In the image processing method provided by the embodiment of the present application, the execution subject may be an image processing apparatus, or an electronic device, or a functional module or entity in the electronic device. In the embodiment of the present application, an example of a method for executing a picture processing by an electronic device is described.

Fig. 4 is a schematic flow chart of a picture processing method according to an embodiment of the present application. As shown in fig. 4, a method for processing a picture provided in an embodiment of the present application may include the following steps 101 to 104.

Step 101, the electronic device obtains a frequency parameter of a display module of the electronic device touched by a user.

In some embodiments of the present application, the frequency parameter may specifically be a touch frequency of a user touching a display module of the electronic device.

In some embodiments of the present application, when the electronic device starts the first application, the electronic device may sequentially send, through the target graphics card, each frame of the display frame corresponding to the first application to the display module, so that the display module may sequentially send each frame of the display frame to display the display frame corresponding to the first application, so that the electronic device may start to acquire the frequency parameter.

In some examples, the first application may include any one of the following: game-like applications, video-like applications, short video-interactive-like applications, chat-like applications, etc.

In some examples, the target graphics card may be a stand-alone graphics card, where the target graphics card may be disposed inside or outside the electronic device.

Under the condition that the target display card is arranged in the electronic equipment, one end of the target display card can be electrically connected with the SoC of the electronic equipment, and the other end of the target display card can be electrically connected with the display module (Liquid Crystal Display Module, LCM) of the electronic equipment.

As shown in fig. 5, an SoC, an LCM, and a target graphics card (e.g., an independent graphics card) are disposed in the electronic device, where the SoC display serial interface transmitting (Displayserial Interface Transmitter, DSI-TX) 0 module is electrically connected to the independent graphics card display serial interface receiving (Displayserial Interface Receiver, DSI-RX) 0 module, and the SoC camera serial interface receiving (Camera serial interface Receiver, CSI-RX) 0 module is electrically connected to the independent graphics card camera serial interface transmitting (Camera serial interface Transmitter, CSI-TX) 0 module, and the independent graphics card DSI-TX1 module is electrically connected to the LCM display touch driver chip, so that, when the electronic device starts the first application, the SoC can transmit each frame of the display frame corresponding to the first application to the independent graphics card through the SoC DSI-TX0 module and the independent graphics card, so that the independent graphics card can sequentially display each frame to display the corresponding display frame of the first application through the independent graphics card CSI-TX0 module of the independent graphics card.

After the independent display card receives a frame of the display screen corresponding to the first application program, the independent display card may directly send the frame to the LCM, and so on, so as to send each frame to the LCM. Alternatively, the independent graphics card may process based on the one frame and then send the one frame to the LCM, and so on, to send each frame to the LCM.

For example, in connection with fig. 5, a function module (IP) is further provided in the independent graphics card, so that the electronic device may process the display screen through the function module of the independent graphics card.

In some examples, the processing of the display by the above functional module may include at least one of: frame insertion processing, noise reduction processing, super division processing, color calibration processing, and color enhancement processing. It will be appreciated that the processing of the display by the target graphics card may include at least one of: frame insertion processing, noise reduction processing, super division processing, color calibration processing, and color enhancement processing.

The following will take a frame inserting process as an example for processing a display screen by a target graphics card.

In some embodiments of the present application, before the step 101, the method for processing a picture provided in the embodiments of the present application may further include the following steps 201 and 202.

Step 201, the electronic device determines a mode corresponding to a first application scene where the electronic device is located.

In some embodiments of the present application, when the electronic device opens the first application, the electronic device may determine, according to application information of the first application, a first application scenario where the electronic device is located, so that the electronic device may determine a mode corresponding to the first application scenario. Wherein the application information may include at least one of: application identification ID, application type ID.

In one example, at least one first correspondence is included in the electronic device, where each first correspondence is a correspondence between one application information and one application scenario, so that the electronic device may determine, from at least one application information in the at least one first correspondence, one application information that is the same as the application information of the first application program, and determine one application scenario corresponding to the one application information as the first application scenario.

In this embodiment of the present application, the mode corresponding to the first application scenario may specifically be a first mode or a second mode.

Under the condition that the target display card processes the display picture into the frame inserting process, the first mode can be a low-delay frame inserting mode, and the second mode can be a common frame inserting mode.

It should be noted that, for the description of the low-latency frame inserting mode and the normal frame inserting mode, reference may be made to the specific description above, and the embodiments of the present application are not repeated here.

In some embodiments of the present application, the first mode is: generating an inserting frame mode of inserting frame picture frames based on one picture frame in the display picture, wherein the second mode is as follows: generating an interpolation mode of interpolation frame picture frames based on two adjacent picture frames in the display picture; the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

It can be understood that, since the first mode needs to generate an interpolated frame based on one frame in the display screen (i.e. an interpolated frame inserted between the one frame and a next frame of the one frame), that is, in the case that the target graphics card receives one frame from the SoC, the interpolated frame may be directly generated and directly output the one frame to the display module, without waiting for the target graphics card to receive the next frame of the one frame from the SoC, the output delay of the frame of the target graphics card in the first mode is lower, so that after the first mode is used to interpolate the display screen, the waiting time required by the display module to switch between different frames of the display screen is shorter, and the touch response delay of the display screen is lower; in addition, since the first mode is to generate an interpolation frame based on one frame in the display screen, the position of the moving object in the interpolation frame generated in this way is not accurate, that is, the image quality of the interpolation frame is low, and therefore, after the display screen is processed by the first mode, the image quality of the display screen is low.

In addition, because the second mode needs to generate an interpolated frame based on two adjacent frame frames in the display frame (i.e. the interpolated frame inserted between the two adjacent frame frames), that is, when the target display card receives one frame from the SoC, the target display card does not directly output the one frame to the display module, but needs to wait for the target display card to receive the next frame of the one frame from the SoC to generate the interpolated frame, so as to perform the interpolated processing on the display frame, the output delay of the frame of the target display card in the second mode is higher, so that the waiting time required for switching between different frame frames displayed by the display module is longer after the second mode is used for the interpolated processing on the display frame, and the touch response delay of the display frame is higher; in addition, since the second mode is to generate the frame-inserted frame based on two adjacent frame frames in the display screen, the position of the moving object in the generated frame-inserted frame is accurate, that is, the image quality of the frame-inserted frame is high, and therefore, the image quality of the display screen is high after the display screen is processed by the second mode.

It should be noted that, the "output delay of a frame" can be understood as: and a time delay between a time when the frame is input from the SoC to the target display card and a time when the frame is output from the target display card to the display module. The above "touch response delay" can be understood as: and a time delay from the moment when the user performs touch operation on the display module to the moment when the display picture of the display module changes.

In some embodiments of the present application, at least one second correspondence is included in the electronic device, where each second correspondence is a correspondence between one application scenario and one mode, so that the electronic device may determine, from at least one application scenario in the at least one second correspondence, one application scenario that is the same as the first application scenario, and determine, as a mode corresponding to the first application scenario, one mode corresponding to the one application scenario.

Step 202, the electronic device processes the display picture by using a mode corresponding to the first application scene through the target display card.

In some embodiments of the present application, when the mode corresponding to the first application scenario is the first mode, the electronic device may generate, through the target graphics card, each frame-inserting frame using each frame in the display frame, and insert each frame-inserting frame between every two adjacent frame frames, so as to process the display frame using the first mode.

In some embodiments of the present application, when the mode corresponding to the first application scenario is the second mode, the electronic device may generate, through the target graphics card, one frame-inserted frame using every two adjacent frame frames, and the frame-inserted frame is inserted between two frame frames that generate the frame-inserted frame, so as to process the display frame using the second mode.

Therefore, the electronic device can determine the mode corresponding to the first application scene where the electronic device is located (namely, the mode required by the user) and then process the display screen by using the mode required by the user through the target display card, so that the electronic device can adaptively adjust the touch response delay and the image quality of the display screen.

In some embodiments of the present application, the electronic device may obtain, through the target graphics card, a frequency parameter of a user touching a display module of the electronic device. Alternatively, as shown in fig. 6 in conjunction with fig. 4, the above step 101 may be specifically implemented by the following steps 101a and 101 b.

Step 101a, the electronic device obtains the number of times of receiving the first signal in a preset time through the target display card.

In this embodiment of the present application, the first signal is sent by the display module when the display module detects that the user touches the display module.

In some embodiments of the present application, the preset duration may be a duration preset by a user, or a duration preset in an electronic device. For example, the preset duration may be specifically 0.5 seconds(s), or the preset duration may be specifically 2s, or the preset duration may be specifically 10s, and the specific preset duration may be set according to the actual usage scenario requirement, which is not specifically limited in this application.

In some embodiments of the present application, the first signal may be a touch interrupt signal TP-INT.

In some embodiments of the present application, referring to fig. 5, an interrupt counter is further disposed in the target graphics card, and the LCM may be electrically connected to the SoC and the interrupt counter, respectively, so that, when the LCM detects that the user touches the LCM, the LCM may send TP-INT to the SoC and the interrupt counter, respectively, so that the interrupt counter may increase the count value by 1, and the SoC may perform a corresponding operation according to the TP-INT.

It should be noted that, for the description of the SoC executing the corresponding operation according to TP-INT, reference may be made to the specific description in the related art, and the embodiments of the present application are not repeated herein.

In some embodiments of the present application, at a start time when the electronic device processes the display screen through the target graphics card, the electronic device may set a count value of the interrupt counter to zero and start the first timer, where a time duration of the first timer is a preset duration, so that the electronic device may read the count value of the interrupt counter and determine the count value as a number of times of receiving the first signal received in the preset duration under a condition that the first timer is overtime.

Step 101b, the electronic device determines the frequency parameter according to the preset duration and the receiving times.

In some embodiments of the present application, the electronic device may determine the frequency parameter by dividing the number of times of reception by a value of a preset duration through an interrupt counter of the target graphics card, so as to determine the frequency parameter.

Therefore, in the subsequent step, the electronic device can accurately determine whether the user needs smaller touch response delay based on the frequency parameter so as to accurately control the target display card to process in a mode meeting the user's use requirement, thereby realizing that the electronic device can adaptively adjust the touch response delay and the image quality of the display screen.

Step 102, the electronic device determines whether the frequency parameter is greater than a preset frequency parameter.

In some embodiments of the present application, the preset frequency parameter may be a frequency parameter set by a user, or a frequency parameter preconfigured in the electronic device.

The preset frequency parameter may be a preset touch frequency. For example, the preset frequency parameter may be 3 touches per second, or the preset frequency parameter may be 5 touches per second, or the preset frequency parameter may be 10 touches per second.

In some embodiments of the present application, the electronic device may determine, through an interrupt counter of the target graphics card, whether the frequency parameter is greater than a preset frequency parameter.

In this embodiment of the present application, since the frequency parameter of the user touching the display module of the electronic device is related to the touch response delay required by the user, if the frequency parameter is larger, the user may be considered to be performing frequent touch operation on the display module, that is, may be considered to be performing less touch response delay required by the user, or if the frequency parameter is smaller, the user may be considered to be not performing frequent touch operation on the display module, that is, may be considered to be performing less touch response delay not required by the user. Therefore, the electronic device may determine whether the frequency parameter is larger or smaller by determining whether the frequency parameter is larger than a preset frequency parameter, so as to determine whether the user needs smaller touch response delay.

And 103, under the condition that the frequency parameter is larger than the preset frequency parameter, the electronic equipment processes the display picture through the target display card by using the first mode.

In some embodiments of the present application, in a case where the target graphics card processes the display screen as a frame inserting process, the first mode may be a low-latency frame inserting mode.

In some embodiments of the present application, if the frequency parameter is greater than the preset frequency parameter and the target graphics card is being processed using the second mode, the electronic device may switch the mode of processing the target graphics card from the second mode to the first mode.

In some examples, if the frequency parameter is greater than the preset frequency parameter, if the target graphics card is being processed using the second mode, that is, the mode corresponding to the first application scenario is the second mode, the interrupt counter of the target graphics card may send an interrupt signal to the functional module of the target graphics card, so that the functional module may switch the mode of processing by the target graphics card from the second mode to the first mode.

In this embodiment of the present application, the time delay of outputting the picture frame when the target graphics card uses the first mode is lower than the time delay of outputting the picture frame when the target graphics card uses the second mode.

In this embodiment of the present invention, if the above frequency parameter is greater than the preset frequency parameter, it may be considered that the user is frequently performing touch operation on the display module, that is, it may be considered that the user may need less touch response delay, so the electronic device may switch the mode of processing the target display card to the first mode with lower output delay of the frame, and in this way, under the condition that the user performs touch operation on the display module, the electronic device may quickly output the frame to the display module through the target display card, so that the display module may quickly update the currently displayed frame, and further the display screen may quickly change according to the touch operation of the user, so that the touch response delay of the display screen is less.

In some embodiments of the present application, if the frequency parameter is greater than the preset frequency parameter and the target graphics card is being processed using the first mode, the electronic device may set the count value of the interrupt counter of the target graphics card to zero, and acquire the frequency parameter of the user touching the display module of the electronic device again.

In this embodiment of the present invention, if the frequency parameter is greater than the preset frequency parameter and the target graphics card is being processed using the first mode, that is, the mode corresponding to the first application scenario is the first mode, it may be considered that the user may need less touch response delay, and the display screen of the electronic device may be rapidly changed according to the touch operation of the user, so the electronic device may not switch the mode (that is, the first mode) used for processing the target graphics card.

A specific scheme of processing the display screen by the electronic device using the first mode through the target graphics card will be illustrated below.

In some embodiments of the present application, as shown in fig. 7 in conjunction with fig. 4, the above step 103 may be specifically implemented by the following steps 103a and 103 b.

Step 103a, under the condition that the frequency parameter is greater than the preset frequency parameter, under the condition that the electronic device obtains a first picture frame of the display picture, the electronic device generates a first frame inserting picture frame based on the first picture frame and the first motion vector through the target display card, and outputs the first picture frame to the display module.

In some embodiments of the present application, the first frame may specifically be a frame acquired by the electronic device through the target graphics card.

In this embodiment of the present application, the first motion vector is any one of the following: the target video card determines a historical motion vector according to a picture frame positioned before the first picture frame of the display picture, or predicts a predicted motion vector obtained by the target video card according to the first picture frame.

Wherein the first motion vector is used for indicating the motion condition of the moving object in the first picture frame.

In some embodiments of the present application, in a case where the first frame is the ith frame of the display screen, the first motion vector is a historical motion vector determined by the target graphics card according to a frame of the display screen that is located before the first frame, and i is a positive integer greater than 1.

It will be understood that if the first frame is the i-th frame of the display frame, it may be considered that there is a partial frame located before the first frame in the display frame, that is, the electronic device may have processed the partial frame and obtained the motion vector of the moving object in the partial frame (that is, the first motion vector), and the motion vector of the moving object in the frame in the display frame may be the same, so the electronic device may directly determine the first motion vector as the motion vector of the moving object in the first frame.

In some embodiments of the present application, in a case where the first frame is the first frame of the display screen, the first motion vector is a predicted motion vector predicted by the target graphics card according to the first frame.

It is understood that if the first frame is the first frame of the display screen, it may be considered that there is no frame located before the first frame in the display screen, that is, the electronic device may not process any frame in the display screen and obtain the motion vector of the moving object in any frame in the display screen, and therefore, the electronic device may determine the predicted motion vector obtained by predicting the target graphics card from the first frame as the motion vector of the moving object in the first frame.

In some embodiments of the present application, the electronic device may output the first frame to the display module at a time when the first frame-inserting frame is generated.

Step 103b, the electronic device outputs the first frame inserting picture frame to the display module.

In some embodiments of the present application, the electronic device may output the first frame-inserting picture frame to the display module according to the specified frame rate. The specified frame rate may be a frame rate corresponding to the first mode, or a frame rate preconfigured by the electronic device, or a frame rate set by a user.

In some embodiments of the present application, in a case where the electronic device obtains a next frame of the first frame of the display screen, the electronic device may execute the above step 103a and step 103b again to generate a next frame of the first frame, and when the next frame is generated, output the next frame to the display module, and output the next frame to the display module according to the specified frame rate, and so on, until all frames of the display screen and all frames of the frame are output.

It can be understood that, when the electronic device uses the first mode to perform frame insertion processing on the display screen through the target display card, the electronic device directly outputs each frame to the display module when receiving each frame from the SoC through the target display card, so that after the frame insertion processing is performed on the display screen by using the first mode, the touch response delay of the display screen is low; in addition, since the electronic device generates the frame of the frame-inserted picture using the inaccurate historical motion vector, the position of the moving object in the frame of the frame-inserted picture generated in this way is inaccurate, and thus the image quality of the display picture is low after the frame-inserted process is performed on the display picture using the first mode.

Therefore, the electronic device can directly generate the first frame inserting frame based on the first frame and the first motion vector in a short time through the target display card under the condition that the electronic device can acquire the first frame of the display frame, so that the electronic device can immediately output the first frame to the display module after the short time, and the touch response delay of the display frame can be reduced.

A specific scheme of switching the mode of processing the target graphics card from the second mode to the first mode by the electronic device will be illustrated below.

In some embodiments of the present application, the mode corresponding to the first application scenario includes a second mode. Before the step 103a, the method for processing a picture provided in the embodiment of the present application may further include the following step 301, and the step 103a may be specifically implemented by the following step 103a 1.

Step 301, when the frequency parameter is greater than the preset frequency parameter, and when the electronic device obtains the fourth frame, the electronic device determines the fourth frame as a third frame, and outputs the third frame to the display module.

In this embodiment of the present application, the fourth frame may specifically include: and when the second mode is switched to the first mode, the electronic equipment acquires the picture frame. It is understood that, among the picture frames of the display picture described above, the fourth picture frame is located before the first picture frame.

In some embodiments of the present application, when the electronic device obtains the fourth frame through the target graphics card, the electronic device may directly output a previous frame of the fourth frame to the display module, directly determine the fourth frame as the third frame-inserting frame, and output the third frame-inserting frame to the display module according to the specified frame rate.

It can be understood that, since the mode corresponding to the first application scenario includes the second mode, that is, the touch response delay of the current display frame of the electronic device is higher, in order to reduce the touch response delay, the electronic device may directly determine the fourth frame as the third frame-inserting frame, so as to reduce the time delay of the output frame of the target graphics card.

Step 103a1, when the electronic device obtains the first frame of the display screen, the electronic device generates a first frame-inserting frame based on the first frame and the first motion vector through the target display card, and outputs the first frame to the display module.

It is understood that after the electronic device outputs the first frame to the display module, the electronic device may output the first frame-inserted frame to the display module.

For example, as shown in fig. 8, assuming that the SoC outputs each frame of the display frame to the target video card according to a frame rate of 30Hz, for example, the SoC may output each frame of the display frame to the target video card at time t0 to time t5, where a time interval between every two adjacent time points in time t0 to time t5 is 33.3 milliseconds (ms), so when the first application program (for example, the game application program) is started, the electronic device may determine, according to application information of the first application program, a first application scene (i.e., a game scene) where the electronic device is located, and determine a mode (for example, a second mode) corresponding to the game scene, where the specified frame rate corresponding to the mode corresponding to the first application scene is 60Hz, for example, the target video card may output each frame of the display frame to the display module at time t1 to time t5 and time t1 'to time t5', where the SoC is determined based on the frame rate 60Hz, as shown in fig. 9, and thus the target video card may output a frame to the target video card at time t0, and then may output a frame to the target video card at time t1 to time t2 (for example, the frame B may be generated at time t1 to time t 2) and the frame B and the frame may be output to the target video card at time B and the frame b+2. Thus, the SoC may output the frame C to the target graphics card at time t2, so that the target graphics card may receive the frame C, and at this time, the target graphics card may generate the frame (b+c)/2 based on the frame B and the frame C, output the frame B to the display module at time t2, and output the frame (b+c)/2 to the display module at time t 2'. Then, the SoC may output the frame D to the target graphics card at time t3, so that the target graphics card may receive the frame D, and if it is determined that the frequency parameter is greater than the preset frequency parameter at this time, the electronic device may switch the second mode to the first mode, directly output the frame C to the display module, and use the frame D as the frame insertion frame D, and output the frame D to the display module at time t 3'. The SoC can output the frame E to the target video card at time t4, so that the target video card can receive the frame E, generate the frame-inserting frame E ' based on the frame E and the historical motion vector, output the frame E to the display module at time t4, output the frame-inserting frame E ' to the display module at time t4', and so on.

Therefore, the electronic device can directly determine the fourth frame as the third frame under the condition that the fourth frame is acquired through the target display card, and output the third frame to the display module to reduce the time delay of the output frame of the target display card, then acquire the first frame through the target display card, generate the first frame, and sequentially output the first frame and the first frame to the display module, namely, process the display frame through the target display card by using the first mode, so as to further reduce the time delay of the output frame of the target display card, thereby further reducing the touch response delay of the display frame, and further reducing the probability that the display frame cannot respond to the touch operation of the user in time.

And 104, under the condition that the frequency parameter is smaller than the preset frequency parameter, the electronic equipment processes the display picture through the target display card by using a second mode.

In some embodiments of the present application, in a case where the target graphics card processes the display screen as a frame inserting process, the second mode may be a normal frame inserting mode.

In some embodiments of the present application, if the frequency parameter is smaller than the preset frequency parameter and the target graphics card is being processed using the first mode, the interrupt counter of the target graphics card may send an interrupt signal to the functional module of the target graphics card, so that the functional module may switch the mode of processing the target graphics card from the first mode to the second mode.

In this embodiment of the present invention, if the frequency parameter is smaller than the preset frequency parameter, it may be considered that the user does not frequently perform the touch operation on the display module, that is, it may not be considered that the user needs smaller touch response delay, so the electronic device may switch the mode of processing the target display card to the second mode with higher output delay of the frame, so that the target display card has sufficient time to process the frame, so that the image quality of the frame output by the target display card is higher, and further the image quality of the display frame is higher.

In some embodiments of the present application, if the target graphics card is being processed using the second mode under the condition that the frequency parameter is smaller than the preset frequency parameter, the electronic device may set the count value of the interrupt counter of the target graphics card to zero, and acquire the frequency parameter of the user touching the display module of the electronic device again.

In this embodiment, if the frequency parameter is smaller than the preset frequency parameter and the target graphics card is being processed in the second mode, it is considered that the user may not need smaller touch response delay and the image quality of the display screen of the electronic device is higher, so the electronic device may not switch the mode (i.e. the second mode) used by the target graphics card for processing.

A specific scheme of processing the display screen by the electronic device using the second mode through the target graphics card will be illustrated below.

In some embodiments of the present application, as shown in fig. 9 in conjunction with fig. 4, the above step 104 may be specifically implemented by the following steps 104a to 104 c.

Step 104a, when the electronic device obtains the second frame and the third frame of the display screen, the electronic device determines a second motion vector according to the second frame and the third frame through the target video card.

In this embodiment of the present application, the third frame is a frame next to the second frame.

It will be appreciated that in the case where the electronic device acquires the second picture frame of the display screen, the electronic device does not process the second picture frame, but waits for the third picture frame to be acquired, and then determines the second motion vector according to the second picture frame and the third picture frame.

In some embodiments of the present application, the second frame and the third frame may specifically be frame acquired by the electronic device through the target graphics card.

In this embodiment of the present application, the second motion vector is used to indicate the motion condition of the moving object in the second frame and the third frame

It should be noted that, for the description of determining the second motion vector according to the second frame and the third frame by the target graphics card, reference may be made to the specific description in the related art, and the embodiments of the present application are not repeated herein.

Step 104b, the electronic device generates a second frame inserting picture frame based on the second picture frame and the second motion vector through the target display card, and outputs the second picture frame to the display module.

In some embodiments of the present application, the electronic device may output the second frame to the display module at a time when the second frame-inserting frame is generated.

Step 104c, the electronic device outputs the second frame inserting picture frame to the display module.

In some embodiments of the present application, the electronic device may output the second frame-inserting picture frame to the display module according to the specified frame rate. The specified frame rate may be a frame rate corresponding to the second mode, or a frame rate preconfigured by the electronic device, or a frame rate set by a user.

In some embodiments of the present application, in a case where the electronic device obtains a next frame of the third frame of the display screen, the electronic device may execute the steps 104a to 104c again to generate a next frame of the second frame, and when the next frame is generated, output the third frame to the display module, and output the next frame to the display module according to the specified frame rate, and so on, until all frames of the display screen and all frames of the frame are output.

It can be understood that when the electronic device uses the second mode to perform frame inserting processing on the display screen through the target display card, the electronic device does not directly output each frame to the display module when receiving each frame from the SoC through the target display card, but waits for outputting each frame to the display module according to the designated frame rate when receiving the next frame of each frame from the SoC through the target display card, so that after performing frame inserting processing on the display screen through the second mode, the touch response delay of the display screen is higher; in addition, the electronic device determines the motion vector according to each picture frame and the next picture frame of each picture frame, so that the accuracy of the motion vector is high, the position of the moving object in the generated picture frame is accurate, and the picture quality of the display picture is high after the picture frame is processed by the second mode.

Therefore, the electronic device can accurately determine the second motion vector based on the second picture frame and the third picture frame when the second picture frame and the third picture frame of the display picture are acquired, so that the position of the moving object in the second frame inserting picture frame generated based on the second picture frame and the second motion vector is accurate, namely the picture quality of the second frame inserting picture frame is high, and the picture quality of the display picture can be improved.

As can be seen from the foregoing, in the embodiment of the present application, in a process that the electronic device processes the display frame through the target graphics card, the electronic device may obtain a frequency parameter of a user touching the display module of the electronic device, and determine whether the user needs a smaller touch response delay according to the frequency parameter, so that the electronic device may process the display frame through the target graphics card using a first mode with a lower output delay of the frame under the condition that the user needs a smaller touch response delay, so that the touch response delay of the display frame of the electronic device is smaller; or, the electronic device may process the display screen through the target video card using the second mode with the higher output delay of the frame under the condition that the user does not need smaller touch response delay, so that the target video card may use more time to process, and further, the image quality of the display screen of the electronic device is higher.

The embodiment of the application provides a picture processing method, an electronic device can firstly acquire a frequency parameter of a display module of the electronic device touched by a user, and then process a display picture corresponding to a first mode through a target display card under the condition that the frequency parameter is larger than a preset frequency parameter, or process the display picture corresponding to a second mode through the target display card under the condition that the frequency parameter is smaller than the preset frequency parameter; the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode. The electronic device can acquire the frequency parameter of the display module of the electronic device touched by the user firstly, then under the condition that the frequency parameter is larger than the preset frequency parameter, namely under the condition that the user frequently performs touch operation on the display module, the touch response delay which is possibly lower in requirement of the user is determined, and the target display card uses the first mode with lower time delay of the output picture frame, so that the target display card can rapidly output the picture frame, the electronic device can rapidly update the displayed picture frame, the display picture is rapidly updated, and the touch response delay of the display picture of the electronic device is further reduced, therefore, the probability that the display picture cannot timely respond to the touch operation of the user can be reduced; or under the condition that the frequency parameter is smaller than the preset frequency parameter, namely, the condition that the user does not frequently perform touch operation on the display module, determining that the user may not need lower touch response delay, and using the second mode with higher time delay of the output picture frame by the target display card to enable the target display card to have more time to process the picture frame of the display picture, so that the picture quality of the picture frame output by the target display card is higher, and further, the picture quality of the display picture of the electronic equipment can be improved. In summary, the electronic device in the present application can adaptively adjust the touch response delay and the image quality of the display screen according to the frequency parameter, so that the probability that the image quality of the display screen cannot meet the user requirement can be reduced.

Of course, since the above frequency parameter may also be equal to the preset frequency parameter, the electronic device may process the display screen by using a certain mode through the target display.

In some embodiments of the present application, after the step 101, the method for processing a picture provided in the embodiments of the present application may further include a step 105 or a step 106 described below.

Step 105, the electronic device processes the display screen by using the first mode through the target graphics card under the condition that the frequency parameter is equal to the preset frequency parameter.

In some embodiments of the present application, in a case where a user sets the first mode to a default mode in the electronic device or the first mode is preconfigured to the default mode in the electronic device, the electronic device processes, through the target graphics card, the display screen using the first mode if the frequency parameter is equal to the preset frequency parameter.

And 106, under the condition that the frequency parameter is equal to the preset frequency parameter, the electronic equipment processes the display picture through the target display card by using the second mode.

In some embodiments of the present application, in a case where the user sets the second mode to a default mode in the electronic device, or the second mode is preconfigured to the default mode in the electronic device, the electronic device processes the display screen by using the second mode through the target graphics card in a case where the frequency parameter is equal to the preset frequency parameter.

Therefore, the electronic device can process the display picture through the first mode or the second mode by using the target display card under the condition that the frequency parameter is equal to the preset frequency parameter, so that the situation that the electronic device cannot determine the mode used by the target display card to process the display picture when the frequency parameter is equal to the preset frequency parameter can be avoided.

Fig. 10 shows a schematic diagram of one possible structure of an electronic device involved in an embodiment of the present application. As shown in fig. 10, the electronic device includes: a system-on-chip SoC 10; a target graphics card 11, which is in communication connection with the system-on-chip SoC 10, and in which an interrupt timer 111 is provided; the display module 12 is in communication connection with the target display card 11, the target interface of the display module 12 is also in communication connection with the interrupt timer 111 and the system-on-chip SoC 10, and the display module 12 is configured to send an interrupt signal to the interrupt timer 111 and the system-on-chip SoC 10 through the target interface when the user touches the display module 12.

In this embodiment of the present application, the interrupt counter 111 is configured to determine, according to the interrupt signal, a frequency parameter of the user touching the display module 12 of the electronic device.

It should be noted that, for the description of determining the frequency parameter by the interrupt counter 111 according to the interrupt signal, reference may be made to the specific description in the above embodiment, which is not described herein.

In this embodiment of the present application, the target graphics card 11 is configured to process, in a case where the frequency parameter is greater than the preset frequency parameter, a display screen output by the system-on-chip SoC 10 by using a first mode; or, in the case that the frequency parameter is smaller than the preset frequency parameter, the second mode is used to process the display screen output by the system-on-chip SoC 10.

It should be noted that, for the description of processing the display screen output by the SoC 10 by using the first mode or the second mode for the target graphics card 11, reference may be made to the specific description in the above embodiment, and this embodiment will not be repeated here.

The embodiment of the application provides electronic equipment, which comprises a system-on-chip; the system comprises a target display card, a system-level chip and a control unit, wherein the target display card is in communication connection with the system-level chip and is internally provided with an interrupt timer; the display module is in communication connection with the target display card, a target interface of the display module is also in communication connection with the interrupt timer and the system-level chip, and the display module is used for sending an interrupt signal to the interrupt timer and the system-level chip through the target interface under the condition that a user touches the display module; the interrupt counter is used for determining the frequency parameter of a display module of the electronic equipment touched by a user according to the interrupt signal; the target display card is used for processing a display picture output by the system-in-chip by using a first mode under the condition that the frequency parameter is larger than a preset frequency parameter; or under the condition that the frequency parameter is smaller than the preset frequency parameter, processing the display picture output by the system-in-chip by using the second mode. The electronic equipment can acquire the frequency parameter of the display module of the electronic equipment touched by the user through the terminal counter, then under the condition that the frequency parameter is larger than the preset frequency parameter, namely under the condition that the user frequently performs touch operation on the display module, the touch response delay which is possibly lower in requirement of the user is determined, and the target display card uses the first mode with lower time delay of the output picture frame, so that the target display card can rapidly output the picture frame, the electronic equipment can rapidly update the displayed picture frame, the display picture can be rapidly updated, and the touch response delay of the display picture of the electronic equipment is further reduced, therefore, the probability that the display picture cannot timely respond to the touch operation of the user can be reduced; or under the condition that the frequency parameter is smaller than the preset frequency parameter, namely, the condition that the user does not frequently perform touch operation on the display module, determining that the user may not need lower touch response delay, and using the second mode with higher time delay of the output picture frame by the target display card to enable the target display card to have more time to process the picture frame of the display picture, so that the picture quality of the picture frame output by the target display card is higher, and further, the picture quality of the display picture of the electronic equipment can be improved. In summary, the electronic device in the present application can adaptively adjust the touch response delay and the image quality of the display screen according to the frequency parameter, so that the probability that the image quality of the display screen cannot meet the user requirement can be reduced.

According to the picture processing method provided by the embodiment of the application, the execution subject can be a picture processing device. In the embodiment of the present application, a method for executing a picture processing by a picture processing device is taken as an example, and the picture processing device provided in the embodiment of the present application is described.

Fig. 11 shows a schematic diagram of a possible configuration of a screen processing apparatus according to an embodiment of the present application. As shown in fig. 11, the screen processing apparatus 50 may include: the obtaining module 51 is configured to obtain a frequency parameter of the display module of the touch screen processing device 50. The processing module 52 is configured to process, by using the target graphics card, the display screen by using the first mode if the frequency parameter acquired by the acquiring module 51 is greater than the preset frequency parameter; or under the condition that the frequency parameter is smaller than the preset frequency parameter, the target display card processes the display picture by using the second mode. The time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

The embodiment of the application provides a picture processing device, because the picture processing device can firstly acquire the frequency parameter of a display module of the picture processing device touched by a user, then under the condition that the frequency parameter is larger than a preset frequency parameter, namely under the condition that the user frequently carries out touch operation on the display module, the touch response delay which is possibly lower in requirement by the user is determined, and the target display card uses a first mode with lower time delay of an output picture frame, so that the target display card can rapidly output the picture frame, the picture processing device can rapidly update the displayed picture frame, the display picture can be rapidly updated, and the touch response delay of the display picture of the picture processing device is further reduced, therefore, the probability that the display picture cannot timely respond to the touch operation of the user can be reduced; or under the condition that the frequency parameter is smaller than the preset frequency parameter, namely, the condition that the user does not frequently perform touch operation on the display module, determining that the user may not need lower touch response delay, and using the second mode with higher time delay of outputting the picture frame by the target display card, so that the target display card can have more time to process the picture frame of the display picture, thereby enabling the picture quality of the picture frame output by the target display card to be higher, and further improving the picture quality of the display picture of the picture processing device. In summary, the image processing device in the present application can adaptively adjust the touch response delay and the image quality of the display image according to the frequency parameter, so that the probability that the image quality of the display image cannot meet the user requirement can be reduced.

In one possible implementation manner, the obtaining module 51 is specifically configured to obtain, by using the target graphics card, the number of times of receiving the first signal received within the preset period of time, where the first signal is sent by the display module when the display module detects that the user touches the display module. The processing module 52 is further configured to determine a frequency parameter according to the preset duration and the number of times of reception acquired by the acquisition module 51.

In one possible implementation manner, the first mode is: generating an inserting frame mode of inserting frame picture frames based on one picture frame in the display picture, wherein the second mode is as follows: an interpolation pattern of interpolation picture frames is generated based on two adjacent picture frames in the display picture.

In a possible implementation manner, the processing module 52 is specifically configured to, when the image processing apparatus 50 obtains a first image frame of the display image, generate, by the target graphics card, a first frame-inserted image frame based on the first image frame and a first motion vector, and output the first image frame to the display module, where the first motion vector is any one of the following: the target display card determines a historical motion vector according to a picture frame positioned before the first picture frame of the display picture, or predicts a predicted motion vector obtained by predicting the target display card according to the first picture frame; and outputting the first frame inserting picture frame to the display module.

In a possible implementation manner, the processing module 52 is specifically configured to determine, by the target graphics card, the second motion vector according to the second frame and the third frame, where the third frame is a frame next to the second frame, when the second frame and the third frame of the display frame are acquired by the frame processing device 50; generating a second frame inserting picture frame based on the second picture frame and a second motion vector through the target display card, and outputting the second picture frame to the display module; and outputting the second frame inserting picture frame to the display module.

In a possible implementation manner, the processing module 52 is further configured to process, by using the target graphics card, the display screen through the first mode when the frequency parameter is equal to the preset frequency parameter after the obtaining module 51 obtains the frequency parameter of the display module of the user touching the screen processing device 50; or under the condition that the frequency parameter is equal to the preset frequency parameter, the target display card processes the display picture by using the second mode.

The image processing apparatus in the embodiment of the present application may be an electronic device, or may be a component in an electronic device, for example, an integrated circuit or a chip. The electronic device may be a terminal, or may be other devices than a terminal. Illustratively, the electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a mobile internet appliance (mobile internet device, MID), an Augmented Reality (AR)/Virtual Reality (VR) device, a robot, a wearable device, a super mobile personal computer (ultra-mobile personal computer, UMPC), a netbook or a personal digital assistant (personal digital assistant, PDA), or the like, and may also be a server, a network attached storage (network attached storage, NAS), a personal computer (personal computer, PC), a Television (TV), an teller machine, a self-service machine, or the like.

The image processing apparatus in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

The image processing apparatus provided in this embodiment of the present application can implement each process implemented by the embodiments of the methods of fig. 1 to 9, and in order to avoid repetition, a description is omitted here.

In some embodiments of the present application, as shown in fig. 12, an electronic device 60 is further provided, which includes a processor 61 and a memory 62, where a program or an instruction capable of running on the processor 61 is stored in the memory 62, and when the program or the instruction is executed by the processor 61, the program or the instruction implements each process step of the above-mentioned embodiment of the image processing method, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

The electronic device in the embodiment of the application includes the mobile electronic device and the non-mobile electronic device.

Fig. 13 is a schematic hardware structure of an electronic device implementing an embodiment of the present application.

The electronic device 100 includes, but is not limited to: radio frequency unit 101, network module 102, audio output unit 103, input unit 104, sensor 105, display unit 106, user input unit 107, interface unit 108, memory 109, and processor 110.

Those skilled in the art will appreciate that the electronic device 100 may further include a power source (e.g., a battery) for powering the various components, and that the power source may be logically coupled to the processor 110 via a power management system to perform functions such as managing charging, discharging, and power consumption via the power management system. The electronic device structure shown in fig. 13 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than shown, or may combine certain components, or may be arranged in different components, which are not described in detail herein.

The processor 110 is configured to obtain a frequency parameter of a user touching a display module of the electronic device; under the condition that the frequency parameter is larger than the preset frequency parameter, the display picture is processed by the target display card through the first mode; or under the condition that the frequency parameter is smaller than the preset frequency parameter, the target display card processes the display picture by using the second mode.

The time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame when the target display card is in the second mode.

The embodiment of the application provides electronic equipment, because the electronic equipment can firstly acquire the frequency parameter of a display module of the electronic equipment touched by a user, and then under the condition that the frequency parameter is larger than a preset frequency parameter, namely under the condition that the user frequently performs touch operation on the display module, the touch response delay which is possibly lower in requirement of the user is determined, and the target display card uses a first mode with lower time delay of an output picture frame, so that the target display card can rapidly output the picture frame, the electronic equipment can rapidly update the displayed picture frame, the display picture can be rapidly updated, and the touch response delay of the display picture of the electronic equipment is further reduced, therefore, the probability that the display picture cannot timely respond to the touch operation of the user can be reduced; or under the condition that the frequency parameter is smaller than the preset frequency parameter, namely, the condition that the user does not frequently perform touch operation on the display module, determining that the user may not need lower touch response delay, and using the second mode with higher time delay of the output picture frame by the target display card to enable the target display card to have more time to process the picture frame of the display picture, so that the picture quality of the picture frame output by the target display card is higher, and further, the picture quality of the display picture of the electronic equipment can be improved. In summary, the electronic device in the present application can adaptively adjust the touch response delay and the image quality of the display screen according to the frequency parameter, so that the probability that the image quality of the display screen cannot meet the user requirement can be reduced.

In some embodiments of the present application, the processor 110 is specifically configured to obtain, by using the target graphics card, a number of times of receiving a first signal received within a preset period of time, where the first signal is sent by the display module when detecting that the user touches the display module; and determining the frequency parameter according to the preset duration and the receiving times.

In some embodiments of the present application, the processor 110 is specifically configured to, when the electronic device obtains a first frame of the display screen, generate, by the target graphics card, a first frame-inserted frame based on the first frame and a first motion vector, and output the first frame to the display module, where the first motion vector is any one of: the target display card determines a historical motion vector according to a picture frame positioned before the first picture frame of the display picture, or predicts a predicted motion vector obtained by predicting the target display card according to the first picture frame; and outputting the first frame inserting picture frame to the display module.

In some embodiments of the present application, the processor 110 is specifically configured to, when the electronic device obtains a second frame and a third frame of the display screen, determine, by the target graphics card, a second motion vector according to the second frame and the third frame, where the third frame is a frame next to the second frame; generating a second frame inserting picture frame based on the second picture frame and a second motion vector through the target display card, and outputting the second picture frame to the display module; and outputting the second frame inserting picture frame to the display module.

In some embodiments of the present application, the processor 110 is further configured to process, by the target graphics card, the display screen using the first mode if the frequency parameter is equal to the preset frequency parameter; or under the condition that the frequency parameter is equal to the preset frequency parameter, the target display card processes the display picture by using the second mode.

It should be appreciated that in embodiments of the present application, the input unit 104 may include a graphics processor (graphics processing unit, GPU) 1041 and a microphone 1042, the graphics processor 1041 processing image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capturing mode or an image capturing mode. The display unit 106 may include a display panel 1061, and the display panel 1061 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like. The user input unit 107 includes at least one of a touch panel 1071 and other input devices 1072. The touch panel 1071 is also referred to as a touch screen. The touch panel 1071 may include two parts of a touch detection device and a touch controller. Other input devices 1072 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, a joystick, and so forth, which are not described in detail herein.

Memory 109 may be used to store software programs as well as various data. The memory 109 may mainly include a first memory area storing programs or instructions and a second memory area storing data, wherein the first memory area may store an operating system, application programs or instructions (such as a sound playing function, an image playing function, etc.) required for at least one function, and the like. Further, the memory 109 may include volatile memory or nonvolatile memory, or the memory 109 may include both volatile and nonvolatile memory. The nonvolatile memory may be a read-only memory (ROM), a Programmable ROM (PROM), an Erasable PROM (EPROM), an electrically Erasable EPROM (EEPROM), or a flash memory. The volatile memory may be random access memory (random access memory, RAM), static RAM (SRAM), dynamic RAM (DRAM), synchronous DRAM (SDRAM), double data rate SDRAM (ddr SDRAM), enhanced SDRAM (ESDRAM), synchronous DRAM (synchronous linkDRAM, SLDRAM), and direct memory bus RAM (DRRAM). Memory 109 in embodiments of the present application includes, but is not limited to, these and any other suitable types of memory.

Processor 110 may include one or more processing units; optionally, the processor 110 integrates an application processor that primarily processes operations involving an operating system, user interface, application programs, etc., and a modem processor that primarily processes wireless communication signals, such as a baseband processor. It will be appreciated that the modem processor described above may not be integrated into the processor 110.

The embodiment of the present application further provides a readable storage medium, where a program or an instruction is stored, and when the program or the instruction is executed by a processor, the processes of the above embodiment of the image processing method are implemented, and the same technical effects can be achieved, so that repetition is avoided, and no further description is given here.

Wherein the processor is a processor in the electronic device described in the above embodiment. The readable storage medium includes computer readable storage medium such as computer readable memory ROM, random access memory RAM, magnetic or optical disk, etc.

The embodiment of the application further provides a chip, the chip includes a processor and a communication interface, the communication interface is coupled with the processor, and the processor is used for running a program or an instruction, so as to implement each process of the above embodiment of the image processing method, and achieve the same technical effect, so that repetition is avoided, and no redundant description is provided herein.

It should be understood that the chips referred to in the embodiments of the present application may also be referred to as system-on-chip chips, chip systems, or system-on-chip chips, etc.

The embodiments of the present application provide a computer program product stored in a storage medium, where the program product is executed by at least one processor to implement the respective processes of the embodiments of the method for processing a picture as described above, and achieve the same technical effects, and for avoiding repetition, a detailed description is omitted herein.

It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising one … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in an opposite order depending on the functions involved, e.g., the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to certain examples may be combined in other examples.

From the above description of the embodiments, it will be clear to those skilled in the art that the above-described embodiment method may be implemented by means of software plus a necessary general hardware platform, but of course may also be implemented by means of hardware, but in many cases the former is a preferred embodiment. Based on such understanding, the technical solutions of the present application may be embodied essentially or in a part contributing to the prior art in the form of a computer software product stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk), comprising several instructions for causing a terminal (which may be a mobile phone, a computer, a server, or a network device, etc.) to perform the methods described in the embodiments of the present application.

The embodiments of the present application have been described above with reference to the accompanying drawings, but the present application is not limited to the above-described embodiments, which are merely illustrative and not restrictive, and many forms may be made by those of ordinary skill in the art without departing from the spirit of the present application and the scope of the claims, which are also within the protection of the present application.

Claims

1. A picture processing method, the method comprising:

the method comprises the steps that the electronic equipment obtains frequency parameters of a display module of the electronic equipment touched by a user;

under the condition that the frequency parameter is larger than a preset frequency parameter, the electronic equipment processes a display picture through a target display card by using a first mode; or,

under the condition that the frequency parameter is smaller than a preset frequency parameter, the electronic equipment processes a display picture through a target display card by using a second mode;

and the time delay of the output picture frame of the target display card when the target display card is in the first mode is lower than the time delay of the output picture frame of the target display card when the target display card is in the second mode.

2. The method of claim 1, wherein the electronic device obtaining a frequency parameter of a user touching a display module of the electronic device comprises:

the electronic equipment acquires the times of receiving a first signal received in a preset time through the target display card, wherein the first signal is sent by the display module when the display module detects that a user touches the display module;

and the electronic equipment determines the frequency parameter according to the preset duration and the receiving times.

3. The method of claim 1, wherein the first mode is: generating an inserting frame mode of an inserting frame picture frame based on one picture frame in the display picture, wherein the second mode is as follows: and generating a frame inserting mode of the frame inserting picture frame based on two adjacent picture frames in the display picture.

4. The method of any of claims 1 to 3, wherein the electronic device processing the display screen with the target graphics card using the first mode, comprising:

when the electronic device obtains a first picture frame of the display picture, the electronic device generates a first frame inserting picture frame based on the first picture frame and a first motion vector through the target display card, and outputs the first picture frame to the display module, wherein the first motion vector is any one of the following: the target display card determines a historical motion vector according to a picture frame of the display picture, which is positioned before the first picture frame, or predicts a predicted motion vector obtained by the target display card according to the first picture frame;

and the electronic equipment outputs the first frame inserting picture frame to the display module.

5. The method of any of claims 1 to 3, wherein the electronic device processing the display screen with the target graphics card using the second mode, comprising:

under the condition that the electronic equipment acquires a second picture frame and a third picture frame of the display picture, the electronic equipment determines a second motion vector according to the second picture frame and the third picture frame through the target display card, wherein the third picture frame is the next picture frame of the second picture frame;

the electronic equipment generates a second frame inserting picture frame based on the second picture frame and the second motion vector through the target display card, and outputs the second picture frame to the display module;

and the electronic equipment outputs the second frame inserting picture frame to the display module.

6. The method of claim 1, wherein after the electronic device obtains the frequency parameter of the user touching the display module of the electronic device, the method further comprises:

under the condition that the frequency parameter is equal to the preset frequency parameter, the electronic equipment processes a display picture through the target display card by using the first mode; or,

And under the condition that the frequency parameter is equal to the preset frequency parameter, the electronic equipment processes a display picture through the target display card by using the second mode.

7. An electronic device, the electronic device comprising:

a system-on-chip;

the target display card is in communication connection with the system-level chip, and an interrupt timer is arranged in the target display card;

the display module is in communication connection with the target display card, a target interface of the display module is also in communication connection with the interrupt timer and the system-level chip, and the display module is used for sending interrupt signals to the interrupt timer and the system-level chip through the target interface under the condition that a user touches the display module;

the interrupt counter is used for determining the frequency parameter of a user touching the display module of the electronic equipment according to the interrupt signal;

the target display card is used for processing the display picture output by the system-in-chip by using a first mode under the condition that the frequency parameter is larger than a preset frequency parameter; or under the condition that the frequency parameter is smaller than a preset frequency parameter, processing the display picture output by the system-in-chip by using a second mode.

8. A picture processing apparatus, characterized in that the picture processing apparatus comprises:

the acquisition module is used for acquiring the frequency parameter of the display module of the picture processing device touched by the user;

the processing module is used for processing the display picture by using a first mode through the target display card under the condition that the frequency parameter acquired by the acquisition module is larger than a preset frequency parameter; or under the condition that the frequency parameter is smaller than the preset frequency parameter, processing the display picture by using a second mode through the target display card;

9. The device according to claim 8, wherein the obtaining module is specifically configured to obtain, by using the target graphics card, a number of times of receiving a first signal received within a preset period of time, where the first signal is sent by the display module when the display module detects that a user touches the display module;

the processing module is further configured to determine the frequency parameter according to the preset duration and the receiving times acquired by the acquisition module.

10. The apparatus according to any one of claims 8, wherein the first mode is: generating an inserting frame mode of an inserting frame picture frame based on one picture frame in the display picture, wherein the second mode is as follows: and generating a frame inserting mode of the frame inserting picture frame based on two adjacent picture frames in the display picture.

11. The picture processing device according to any one of claims 8 to 10, wherein the processing module is specifically configured to, when the picture processing device acquires a first picture frame of the display picture, generate, by the target graphics card, a first frame-inserted picture frame based on the first picture frame and a first motion vector, and output the first picture frame to the display module, the first motion vector being any one of: the target display card determines a historical motion vector according to a picture frame of the display picture, which is positioned before the first picture frame, or predicts a predicted motion vector obtained by the target display card according to the first picture frame; and outputting the first frame inserting picture frame to the display module.

12. The picture processing device according to any one of claims 8 to 10, wherein the processing module is specifically configured to determine, by the target graphics card, a second motion vector according to a second picture frame and a third picture frame of the display picture, the third picture frame being a next picture frame of the second picture frame, when the second picture frame and the third picture frame are acquired by the picture processing device; generating a second frame inserting picture frame based on the second picture frame and the second motion vector through the target display card, and outputting the second picture frame to the display module; and outputting the second frame inserting picture frame to the display module.

13. The apparatus according to claim 8, wherein the processing module is further configured to process, by the target graphics card, the display screen using the first mode if the frequency parameter is equal to the preset frequency parameter after the obtaining module obtains the frequency parameter of the display module of the apparatus touched by the user; or under the condition that the frequency parameter is equal to the preset frequency parameter, processing the display picture by the target display card through the second mode.

14. An electronic device comprising a processor and a memory storing a program or instructions executable on the processor, which when executed by the processor, implement the steps of the picture processing method as claimed in any one of claims 1 to 6.

15. A readable storage medium, wherein a program or instructions is stored on the readable storage medium, which when executed by a processor, implements the steps of the picture processing method according to any one of claims 1 to 6.