WO2022141419A1

WO2022141419A1 - Terminal control method and apparatus, and electronic device

Info

Publication number: WO2022141419A1
Application number: PCT/CN2020/142204
Authority: WO
Inventors: 姚亚群; 李波; 王坚
Original assignee: 华为技术有限公司
Priority date: 2020-12-31
Filing date: 2020-12-31
Publication date: 2022-07-07
Also published as: CN115917472A

Abstract

The present application relates to the technical field of artificial intelligence, in particular relates to the technical field of terminal control, and provides a terminal control method and apparatus, and an electronic device. In the present solution, after it is determined that the state related to an image displayed in a display window of an application on a terminal has changed, target parameters related to a display effect of a first image in the terminal may be adjusted so as to prevent the terminal from continuing to operate at high performance or low performance, which helps to solve problems such as the increased power consumption of the terminal or the inability of the display effect to meet user needs, and improves the user experience.

Description

Terminal control method, device and electronic device

technical field

The present application relates to the technical field of artificial intelligence, and in particular, to a terminal control method, device and electronic device.

Background technique

At present, terminals such as mobile phones and computers have become necessities in people's lives. When a user uses the terminal, various application programs (Application, APP) can be installed on the terminal, for example, application programs such as video, game, social networking, and news. However, when a user uses an application program on the terminal, the terminal often presents the content that the application program can provide to the user in the display window of the application program according to the display effect set by the user in the application program or the default display effect of the system, such as: Image content such as pictures, videos, etc., which makes the display effect of the content displayed in the display window of the application program remain unchanged when the user uses the application program on the terminal. However, when the display effect of the content displayed in the display window of the application program on the terminal remains unchanged, the terminal often remains in a high-performance state or in a low-performance state, and then the power consumption of the terminal increases or the display effect cannot meet user needs, etc. question. Therefore, how to prevent the terminal from continuously being in a high-performance state or continuously being in a low-performance state is a technical problem that needs to be solved urgently at present.

SUMMARY OF THE INVENTION

The embodiments of the present application provide a terminal control method, device, and electronic device, which can prevent the terminal from continuously running with high performance or low performance, and help solve problems such as increased power consumption of the terminal or the inability of the display effect to meet user needs, etc. Improved user experience.

In a first aspect, an embodiment of the present application provides a terminal control method. The method includes: determining that a target state is switched from a first state to a second state, where the target state includes a display state of a display window of a first application on a terminal or a terminal currently in use. At least one of the user states of the user, wherein the first image is displayed on the display window of the first application; the target parameter in the terminal is adjusted, and the target parameter is related to the display effect of the first image. Therefore, in this solution, after it is determined that the state related to the image displayed in the display window of the application on the terminal has changed, the parameters related to the display effect of the first image in the terminal are adjusted to improve the display effect of the first image. Adjustments are made to prevent the terminal from continuously running with high performance or low performance, which helps to solve problems such as increased power consumption of the terminal or that the display effect cannot meet user needs, and improves user experience.

In a possible implementation manner, the target state includes a display state, and the display state includes the size of the display window; determining that the target state is switched from the first state to the second state includes: determining that the size of the display window is switched from the first size to the second state Two size. From this, it is determined whether or not the target state has changed. Exemplarily, if the size of the display window is 100mmx80mm when displayed in full screen on the terminal and 50mmx80mm when displayed in half screen, then when the user switches the display window from full screen display to half screen display, the size of the display window is By switching from 100mmx80mm to 50mmx80mm, it can be determined that the size of the display window has changed, that is to say, the target state has changed at this time.

In a possible implementation manner, the target state includes a display state, and the display state includes the target content expressed by the first image; determining that the target state is switched from the first state to the second state includes: determining that the target content is switched from the first content is the second content, wherein the type of the first content is different from the type of the second content. From this, it is determined whether or not the target state has changed. Exemplarily, when the first application is a game application, the user can play the game on the display window of the application or watch others play the game; when the user is playing the game, the content expressed by the first image is the game content, and the content The type of the game is the game category; when the user watches others play games, the content expressed by the first image is video content, and the type of the content is video content; at this time, if the content expressed by the first image is switched by the game content If it is video content, it can be determined that the content expressed by the first image has changed, that is, the target state has changed at this time.

In a possible implementation manner, the target state includes the user state, the user state includes the user's target attention to the first area on the display window, and the first area is used to display part or all of the first image; determining the target state is determined by the first area on the display window. Switching from a state to a second state includes: determining that the target attention degree is switched from the first attention degree to the second attention degree. From this, it is determined whether or not the target state has changed. Exemplarily, if the display screen of the terminal is divided into two areas, the first area is the area where the display window is located, and the second area is the area other than the display window, then when the user's line of sight is switched from the first area After reaching the second area, it can be determined that the user no longer pays attention to the first area. The attention of the image has changed, that is, the target state has changed at this time.

In a possible implementation manner, the method further includes: determining the gaze duration of the user's eyeballs gazing at the first region; and determining the target attention degree according to the duration interval to which the gaze duration belongs. In this way, the camera on the terminal can be used to track the movement state of the user's eyeballs, and when it is determined that the user's eyeballs are fixed on the first area, the timing is started until the user's eyeballs are no longer fixed on the first area, so as to count the number of times the user's eyeballs are fixed on the first area. The fixation duration of an area; then, compare the fixation duration with the preset duration interval to determine the duration interval to which the current fixation duration belongs; finally, obtain the degree of attention corresponding to the duration interval to which the current fixation duration belongs. The user's target attention to the first area on the display window. Exemplarily, if the relationship between the preconfigured duration interval and the degree of attention is: the gaze duration is 0-8s, and the degree of attention is level 1; the gaze duration is 8s-16s, and the degree of attention is level 2; The degree of attention is level 3; then when the statistical fixation duration is 10s, the degree of attention can be determined to be level 2.

In a possible implementation manner, the target state includes a user state, and the user state includes a target operating frequency of the user operating the terminal; determining that the target state is switched from the first state to the second state includes: determining that the target operating frequency is determined by the first operating frequency Switch to the second operating frequency. From this, it is determined whether or not the target state has changed. Exemplarily, if the terminal is a mobile phone, when the operating frequency of the user operating the mobile phone is high, the user is often in the game state; and when the operating frequency of the user operating the mobile phone is low, the user is often in the state of watching videos, so when When it is determined that the operating frequency of the user operating the mobile phone changes, it can be determined that the target state has changed.

In a possible implementation manner, adjusting the target parameter in the terminal includes: reducing at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs, and the processor is used to process the first image; or , increasing at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs. Therefore, the processor in the terminal can be run at a lower working frequency, or the power supply domain to which the processor belongs can be powered at a lower working voltage, so as to reduce the display effect of the first image and prevent the terminal from continuing to use High-performance operation can reduce the power consumption of the terminal; or, the processor in the terminal can run at a higher working frequency, or the power supply domain to which the processor belongs can be powered at a higher working voltage, so as to improve the performance of the first image. display effect, so as to prevent the terminal from running with low performance continuously and improve the display effect of the terminal.

In a possible implementation manner, reducing the operating frequency of the processor in the terminal includes: reducing the video post-processing performance of the decoder in the terminal; reducing the operating voltage of the power supply domain to which the processor belongs, including: reducing the matching of the decoder in the terminal voltage; improving the operating frequency of the processor in the terminal, including: improving the video post-processing performance of the decoder in the terminal; improving the operating voltage of the power supply domain to which the processor belongs, including: improving the matching voltage of the decoder in the terminal.

In a possible implementation manner, adjusting the target parameters in the terminal includes: increasing the number of first image processing algorithms, where the first image processing algorithm is used to process the first image; or, reducing the number of the first image processing algorithms quantity. Therefore, by increasing the number of the first image processing algorithms, the terminal can process the first image with a smaller number of image processing algorithms, so as to reduce the display effect of the first image, thereby preventing the terminal from continuously running with high performance and reducing the power consumption; or by reducing the number of first image processing algorithms, the terminal can process the first image with a larger number of image processing algorithms, so as to improve the display effect of the first image, thereby preventing the terminal from running with low performance continuously and improving the terminal performance. display effect.

In a possible implementation manner, the first image processing algorithm includes: a contour removal (De Contour, DC) algorithm, a mosquito noise removal (De Mosquito, DM) algorithm, and a halo noise removal (De Ring, DR) algorithm, At least one of Motion Estimate and Motion Compensation (MEMC) algorithm, Noise Reduction (NR) algorithm, and Image Super Resolution (SR) algorithm.

In a possible implementation manner, the method further includes: in the case of increasing the number of the first image processing algorithms, the method further includes: reducing the number of the second image processing algorithms, and the second image processing algorithm is used to process the division on the terminal. The image in at least part of the display area outside the area occupied by the window is displayed; in the case of reducing the number of the first image processing algorithms, the method further includes: increasing the number of the second image processing algorithms. Thus, when the display effect of the first image is improved, the number of image display algorithms on the terminal that processes images in areas outside the display window can be reduced, so as to reduce the display effect of images in areas outside the display window and reduce the power consumption of the terminal; or , when the display effect of the first image is reduced, the number of image display algorithms on the terminal for processing images outside the display window can be increased, so as to improve the display effect of images outside the display window.

In a possible implementation manner, the second image processing algorithm includes: a de-contour (De Contour, DC) algorithm, a de-mosquito-noise (De Mosquito, DM) algorithm, and a de-ring noise (De Ring, DR) algorithm, At least one of Motion Estimate and Motion Compensation (MEMC) algorithm, Noise Reduction (NR) algorithm, and Image Super Resolution (SR) algorithm.

In a possible implementation manner, the target parameter includes a frame rate; adjusting the target parameter related to the first image in the terminal includes: dropping frames on the video stream corresponding to the first image, or performing frame dropping on the video stream corresponding to the first image Make up frames. Therefore, when the target parameter is the frame rate, the target parameter is adjusted by dropping or complementing the video stream corresponding to the first image.

In a possible implementation manner, the target parameter includes resolution; adjusting the target parameter related to the first image in the terminal includes: when the terminal sends the first request to the server, adjusting the The resolution of the original image data related to the image, and the first request is used to request to obtain the original image data. Therefore, when the target parameter is the resolution, the target parameter is adjusted by adjusting the resolution carried in the request sent by the terminal to the server.

In a possible implementation manner, the target parameter includes a first parameter corresponding to the first image in the first state; adjusting the target parameter related to the first image in the terminal includes: determining that the first image corresponds to the first image in the second state The second parameter of , the second parameter is of the same type as the first parameter; the first parameter is adjusted according to the first parameter and the second parameter. Therefore, based on the parameters corresponding to the first image before and after the target state changes, the parameters before the target state change are adjusted to improve the accuracy of the adjustment.

In a possible implementation manner, adjusting the first parameter according to the first parameter and the second parameter includes: when there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter; When the deviation value between the first parameter and the second parameter is greater than the preset difference value, the first parameter is adjusted based on the deviation value so that the deviation value is smaller than or equal to the preset difference value. An adjustment of the first parameter is thereby achieved. Exemplarily, if the resolution before the target state change is 1080p, and the resolution after the target state change is 360p, it can be determined that there is a deviation between 1080p and 360p, so 1080p can be directly adjusted to 360p; or, between 1080p and 360p For example, if the difference is greater than 500, you can adjust 1080p based on the difference between the two to control the difference between the two within 500. For example, adjust 1080p to 720p.

In a second aspect, an embodiment of the present application provides a terminal control device, the device includes: a determination module configured to determine that a target state is switched from a first state to a second state, where the target state includes the display of a display window of a first application on the terminal At least one of the state or the user state of the user currently using the terminal, the first image is displayed on the display window of the first application; the determining module is further configured to determine the first image required by the terminal to output the first image in the second state. A parameter, the first parameter includes at least one of image quality, frame rate or resolution; a processing module for adjusting a target parameter in the terminal, where the target parameter is related to the display effect of the first image.

In a possible implementation manner, the target state includes a display state, and the display state includes a size of the display window; the determining module is specifically configured to: determine that the size of the display window is switched from the first size to the second size.

In a possible implementation manner, the target state includes a display state, and the display state includes the target content expressed by the first image; the determining module is specifically configured to: determine that the target content is switched from the first content to the second content, and the first content is different from the type of the second content.

In a possible implementation manner, the target state includes the user state, the user state includes the user's target attention to the first area on the display window, and the first area is used to display part or all of the first image; To: determine that the target attention degree is switched from the first attention degree to the second attention degree.

In a possible implementation manner, the determining module is specifically configured to: determine the gaze duration of the user's eyeballs gazing at the first region, and determine the target attention degree according to the duration interval to which the gaze duration belongs.

In a possible implementation manner, the target state includes a user state, and the user state includes a target operating frequency of the user operating the terminal; the determining module is specifically configured to: determine that the target operating frequency is switched from the first operating frequency to the second operating frequency.

In a possible implementation manner, the processing module is specifically configured to: reduce at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs, and the processor is used to process the first image; or, increase At least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs.

In a possible implementation manner, the processing module is specifically configured to: increase the number of the first image processing algorithms, where the first image processing algorithm is used to process the first image; or reduce the number of the first image processing algorithms.

In a possible implementation manner, when the number of the first image processing algorithm is increased, the processing module is further configured to: reduce the number of the second image processing algorithm, and the second image processing algorithm is used to process the terminal except the display window At least part of the area outside the occupied area displays the image in the area; the processing module is further configured to: increase the number of the second image processing algorithm when the number of the first image processing algorithm is reduced.

In a possible implementation manner, the target parameter includes a frame rate; the processing module is specifically configured to: drop frames on the video stream corresponding to the first image, or perform frame supplementation on the video stream corresponding to the first image.

In a possible implementation manner, the target parameter includes resolution; the processing module is specifically configured to: when the terminal sends the first request to the server, adjust the resolution of the original image data related to the first image carried in the first request rate, the first request is used to request the acquisition of raw image data.

In a possible implementation manner, the target parameter includes a first parameter corresponding to the first image in the first state; the processing module is further configured to: determine a second parameter corresponding to the first image in the second state, and the second parameter corresponds to the first image in the second state. The parameter is of the same type as the first parameter; the first parameter is adjusted according to the first parameter and the second parameter.

In a possible implementation manner, the processing module is further configured to: when there is a deviation between the first parameter and the second parameter, adjust the first parameter to the second parameter; or, between the first parameter and the second parameter When the deviation value is greater than the preset difference value, the first parameter is adjusted based on the deviation value, so that the deviation value is less than or equal to the preset difference value.

In a third aspect, an embodiment of the present application provides an electronic device, including: at least one memory for storing a program; and at least one processor for calling a program stored in the memory to execute the method provided in the first aspect.

In a fourth aspect, an embodiment of the present application provides an electronic device, including the apparatus provided in the second aspect.

In a fifth aspect, an embodiment of the present application provides a computer storage medium, where an instruction is stored in the computer storage medium, and when the instruction is executed on a computer, the computer executes the method provided in the first aspect.

In a sixth aspect, an embodiment of the present application provides a computer program product containing instructions, when the instructions are run on a computer, the computer is made to execute the method provided in the first aspect.

In a seventh aspect, an embodiment of the present application provides a terminal control device, including at least one processor and an interface; at least one processor obtains program instructions or data through the interface; at least one processor is configured to execute program line instructions to implement the first method on the one hand.

Description of drawings

The following briefly introduces the accompanying drawings required in the description of the embodiments or the prior art.

FIG. 1a is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

FIG. 1b is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

2a is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

FIG. 2b is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

3a is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

FIG. 3b is a schematic diagram of an exemplary application scenario provided by an embodiment of the present application;

4 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application;

5 is a schematic flowchart of a terminal control method provided by an embodiment of the present application;

6 is a schematic diagram of a step of determining and adjusting a second parameter provided by an embodiment of the present application;

7 is a schematic flowchart of another terminal control method provided by an embodiment of the present application;

FIG. 8 is a schematic structural diagram of a terminal control apparatus provided by an embodiment of the present application;

9 is a schematic structural diagram of an electronic device provided by an embodiment of the present application;

FIG. 10 is a schematic structural diagram of another terminal control apparatus provided by an embodiment of the present application.

Detailed ways

In order to make the objectives, technical solutions and advantages of the embodiments of the present application more clear, the technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

In the description of the embodiments of the present application, words such as "exemplary", "such as" or "for example" are used to mean serving as an example, illustration or illustration. Any embodiments or designs described in the embodiments of the present application as "exemplary," "such as," or "by way of example" should not be construed as preferred or advantageous over other embodiments or designs. Rather, use of words such as "exemplary," "such as," or "by way of example" is intended to present the related concepts in a specific manner.

In the description of the embodiments of the present application, the term "and/or" is only an association relationship for describing associated objects, indicating that there may be three relationships, for example, A and/or B, which may indicate: A alone exists, A alone exists There is B, and there are three cases of A and B at the same time. Also, unless stated otherwise, the term "plurality" means two or more. For example, multiple systems refer to two or more systems, and multiple terminals refer to two or more terminals.

In addition, the terms "first" and "second" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance or implying the indicated technical features. Thus, a feature defined as "first" or "second" may expressly or implicitly include one or more of that feature. The terms "including", "including", "having" and their variants mean "including but not limited to" unless specifically emphasized otherwise.

Figures 1a and 1b together form a schematic diagram of an application scenario provided by an embodiment of the present application. As shown in FIG. 1a, an application a is installed on the terminal 11, and the type of the a application may be a video type. The user opens the a application on the terminal 11 and watches the video, and the video content will be displayed on the display window 12 of the a application at this time. As shown in FIG. 1b, when viewing the video content displayed on the display window 12, the user can zoom the display window 12, that is, adjust the size of the display window 12, and open the b application. The type of the b application can be social. After the user opens the b application, the chat content can be input on the display window 13 of the b application. When the display window 12 changes from the state in FIG. 1a to the state in FIG. 1b, the size of the window changes, and the maximum resolution that the display window 12 can display at this time also changes. After the size of the display window 12 is changed, if the resolution of the video in the display window 12 is not adjusted, the terminal 11 continues to output the video at the original resolution, but this does not bring any value to the user. When outputting videos of different resolutions, the code stream size, video decoding performance, and image post-processing performance required by the terminal 11 are all different, which in turn leads to different power consumption of the terminal. Therefore, when the size of the display window 12 changes, the parameters of the content displayed in the display window 12 can be adjusted to adjust the power consumption of the terminal. It can be understood that when the state of the display window 12 is switched from FIG. 1 b to FIG. 1 a , the parameters of the content displayed in the display window 12 can be adjusted to improve the display effect of the terminal 11 .

For example, in Fig. 1a, the display window 12 can display a maximum resolution of 1600x1200, and in Fig. 1b, the display window can display a maximum resolution of 640x480. At this time, the user is viewing the video with a resolution of 640x480 in Fig. 1b. The subjective experience is the same as that of a user watching a video with a resolution of 1600x1200 in Figure 1a. At this time, if the resolution of the video in the display window 12 is not adjusted, the terminal 11 continues to output the video at a resolution of 1600×1200, but this does not bring any value to the user. In addition, the terminal 11 continues to output video at a resolution of 1600×1200, which will also cause the terminal 11 to continue to run with high power consumption. Therefore, at this time, the resolution of the video displayed in the display window 12 can be reduced, that is, from 1600×1200 to 640×480, which can reduce the power consumption of the terminal 11 without reducing the user experience.

2a and 2b together constitute another schematic diagram of an application scenario provided by the embodiment of the present application. As shown in FIG. 2a, the terminal 11 is installed with a c application, and the type of the c application may be a game. The user opens the c application on the terminal 11 and plays the game, and the game content will be displayed on the display window 14 of the c application at this time. As shown in FIG. 2b, after playing the game for a period of time, the user can end the game and watch other users play the game on the display window 14 of the c application. Obviously, the performance requirements of the terminal 11 are different when the user is playing games and when the user is watching other people play games. If the terminal 11 continues to run with the performance when the user is playing games It is inevitable that the terminal 11 will continue to run with high power consumption, but this will not bring any value to the user, on the contrary, it will increase the power consumption of the terminal 11 . Therefore, at this time, the processing performance of the terminal 11 can be adjusted to prevent the terminal 11 from continuously running with high performance, so as to reduce the power consumption of the terminal 11 . It can be understood that when the state of the display window 14 is switched from FIG. 2b to FIG. 2a, the processing performance of the terminal 11 can be adjusted to prevent the terminal 11 from running with low performance continuously and improve the display effect of the terminal 11.

3a and 3b together form another schematic diagram of an application scenario provided by the embodiment of the present application. As shown in FIG. 3 a , the terminal 11 of the user M has two application display windows opened, namely display

windows

15 and 16 . In the situation shown in FIG. 3 a , the attention of the user M is on the display window 15 ; in the scenario shown in FIG. 3 b , the attention of the user M is transferred from the display window 15 to the display window 16 . When the user M's attention is transferred from the display window 15 to the display window 16, if the output parameters such as the image quality, frame rate, resolution, etc. of the content displayed in the display window 15 are not adjusted, the terminal 11 will continue to use the original Output parameters such as image quality, frame rate, and resolution output the corresponding content, that is, the terminal 11 will continue to process the content displayed in the display window 15 with the original performance; This display will cause a waste of part of the energy consumption on the terminal 11. Therefore, at this time, the processing parameters related to the displayed content in the processing display window 15 on the terminal 11 (such as the operating frequency of the processor, the power supply domain to which the processor belongs) can be working voltage, etc.) to reduce the power consumption of the terminal 11 . In addition, in FIG. 3 b , the processing parameters related to the displayed content in the processing display window 16 on the terminal 11 may also be adjusted, so as to improve the display effect in the display window 16 .

It should be noted that, in this solution, after the state related to the display window of the application on the terminal changes, the processing parameters or output parameters related to the content displayed in the display window on the terminal are adjusted, so as to prevent the terminal from persisting. High or low performance operation. Exemplarily, the state related to the display window of the application on the terminal may include the display state of the display window and/or the user state of the user currently using the terminal; wherein, the display state may include the size of the display window, display content, etc., the user The state may include the user's attention to part or all of the area on the display window, the operation frequency of the user's operation of the terminal, and the like.

It can be understood that, in this solution, the terminal may be a mobile phone, a tablet computer, a digital camera, a personal digital assistant (PDA), a wearable device, a smart TV, a Huawei smart screen, and the like. Exemplary embodiments of the terminal include, but are not limited to, electronic devices equipped with iOS, android, Windows, Harmony OS or other operating systems. The aforementioned terminals may also be other electronic devices, such as laptops, etc., with touch-sensitive surfaces (eg, touch panels). This solution does not specifically limit the type of the terminal.

FIG. 4 is a schematic diagram of a hardware structure of a terminal provided by an embodiment of the present application. As shown in FIG. 4 , the terminal 100 may include a processor 110, an external memory interface 120, an internal memory 121, a universal serial bus (USB) interface 130, a charging management module 140, a power management module 141, a battery 142, Antenna 1, Antenna 2, Mobile Communication Module 150, Wireless Communication Module 160, Audio Module 170, Speaker 170A, Receiver 170B, Microphone 170C, Headphone Interface 170D, Sensor Module 180, Key 190, Motor 191, Indicator 192, Camera 193, A display screen 194, and a subscriber identification module (SIM) card interface 195 and the like. The sensor module 180 may include a pressure sensor 180A, a gyroscope sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and ambient light. Sensor 180L, bone conduction sensor 180M, etc.

It can be understood that the structures illustrated in the embodiments of the present application do not constitute a specific limitation on the terminal 100 . In other embodiments of the present application, the terminal 100 may include more or less components than shown, or some components may be combined, or some components may be separated, or different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

The processor 110 may include one or more processors, for example, the processor 110 may include an application processor (application processor, AP), a modem (modem), a graphics processor (graphics processing unit, GPU), an image signal processor ( image signal processor (ISP), controller, video codec, digital signal processor (DSP), baseband processor, and/or neural-network processing unit (NPU), etc. one or more. Wherein, different processors may be independent devices, or may be integrated in one or more processors. Exemplarily, the processor 110 may process the content to be displayed on the display window of the application program on the terminal 100.

The controller can generate the operation control signal according to the instruction operation code and the timing signal, so as to complete the control of the instruction and execute the instruction.

A memory may also be provided in the processor 110 for storing instructions and data. In some examples, the memory in processor 110 is cache memory. This memory may hold instructions or data that have just been used or recycled by the processor 110 . If the processor 110 needs to use the instruction or data again, it can be directly called from the memory to avoid repeated access, reduce the waiting time of the processor 110, and improve the efficiency of the system.

In some examples, processor 110 may include one or more interfaces. The interface may include integrated circuit (inter-integrated circuit, I2C) interface, integrated circuit built-in audio (inter-integrated circuit sound, I2S) interface, pulse code modulation (Pulse Code Modulation, PCM) interface, Universal Asynchronous Receiver/Transmitter (Universal Asynchronous Receiver/ Transmitter, UART) interface, mobile industry processor interface (MobileIndustryProcessorInterface, MIPI), general input and output (General PurposeI/0Ports, GPIO), subscriber identity module (subscriber identity module, SIM) interface, and/or Universal Serial Bus (UniversalSerialBus) , USB) interface, etc.

It can be understood that the interface connection relationship between the modules illustrated in the embodiments of the present application is only a schematic illustration, and does not constitute a structural limitation of the terminal 100 . In other embodiments of the present application, the terminal 100 may also adopt different interface connection manners in the foregoing embodiments, or a combination of multiple interface connection manners.

The charging management module 140 is used to receive charging input from the charger. The charger may be a wireless charger or a wired charger. In some wired charging examples, the charging management module 140 may receive charging input from the wired charger through the USB interface 130 . In some wireless charging examples, the charging management module 140 may receive wireless charging input through the wireless charging coil of the terminal 100 . While the charging management module 140 charges the battery 142 , it can also supply power to other terminals through the power management module 141 .

The power management module 141 is used for connecting the battery 142 , the charging management module 140 and the processor 110 . The power management module 141 receives input from the battery 142 and/or the charging management module 140, and supplies power to the processor 110, the internal memory 121, the external memory, the display screen 194, the camera 193, the wireless communication module 160, and the like. The power management module 141 can also be used to monitor parameters such as battery capacity, battery cycle times, battery health status (leakage, impedance). In some other examples, the power management module 141 may also be provided in the processor 110 . In other examples, the power management module 141 and the charging management module 140 may also be provided in the same device.

The wireless communication function of the terminal 100 may be implemented by the antenna 1, the antenna 2, the mobile communication module 150, the wireless communication module 160, the modem, the baseband processor, and the like.

Antenna 1 and Antenna 2 are used to transmit and receive electromagnetic wave signals. Each antenna in terminal 100 may be used to cover a single or multiple communication frequency bands. Different antennas can also be reused to improve antenna utilization. For example, the antenna 1 can be multiplexed as a diversity antenna of the wireless local area network. In other examples, the antenna may be used in conjunction with a tuning switch.

The mobile communication module 150 may provide a wireless communication solution including 2G/3G/4G/5G, etc. applied on the terminal 100 . The mobile communication module 150 may include at least one filter, switch, power amplifier, low noise amplifier (LNA) and the like. The mobile communication module 150 can receive electromagnetic waves by at least two antennas including the antenna 1, filter, amplify, etc. the received electromagnetic waves, and transmit them to the modem for demodulation. The mobile communication module 150 can also amplify the signal modulated by the modem, and then convert it into electromagnetic waves for radiation through the antenna 1 . In some examples, at least part of the functional modules of the mobile communication module 150 may be provided in the processor 110 . In some examples, at least part of the functional modules of the mobile communication module 150 may be provided in the same device as at least part of the modules of the processor 110 .

A modem may include a modulator and a demodulator. Wherein, the modulator is used to modulate the low frequency baseband signal to be sent into a medium and high frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low frequency baseband signal. Then the demodulator transmits the demodulated low-frequency baseband signal to the baseband processor for processing. The low frequency baseband signal is processed by the baseband processor and passed to the application processor. The application processor outputs sound signals through audio devices (not limited to the speaker 170A, the receiver 170B, etc.), or displays images or videos through the display screen 194 . In some examples, the modem may be a stand-alone device. In other examples, the modem may be independent of the processor 110 and provided in the same device as the mobile communication module 150 or other functional modules. In other examples, the mobile communication module 150 may be a module in a modem.

The wireless communication module 160 can provide applications on the terminal 100 including wireless local area networks (WLAN) (such as wireless fidelity (Wi-Fi) network), bluetooth (BT), global navigation satellite system (global navigation satellite system, GNSS), frequency modulation (frequency modulation, FM), near field communication technology (near field communication, NFC), infrared technology (infrared, IR) and other wireless communication solutions. The wireless communication module 160 may be one or more devices integrating at least one communication processing module. The wireless communication module 160 receives electromagnetic waves via the antenna 2 , frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processor 110 . The wireless communication module 160 can also receive the signal to be sent from the processor 110 , perform frequency modulation on it, amplify it, and convert it into electromagnetic waves for radiation through the antenna 2 .

In some examples, the antenna 1 of the terminal 100 is coupled with the mobile communication module 150, and the antenna 2 is coupled with the wireless communication module 160, so that the terminal 100 can communicate with the network and other devices through wireless communication technology. The wireless communication technology may include global system for mobile communications (GSM), general packet radio service (GPRS), code division multiple access (CDMA), broadband Code division multiple access (wideband code division multiple access, WCDMA), time division code division multiple access (time-division code division multiple access, TD-SCDMA), long term evolution (long term evolution, LTE), fifth generation, new air interface ( new radio, NR), BT, GNSS, WLAN, NFC, FM, and/or IR technologies, etc. The GNSS may include global positioning system (global positioning system, GPS), global navigation satellite system (global navigation satellite system, GLONASS), Beidou navigation satellite system (beidou navigation satellite system, BDS), quasi-zenith satellite system (quasi -zenith satellite system, QZSS) and/or satellite based augmentation systems (SBAS).

The terminal 100 implements a display function through a GPU, a display screen 194, an application processor, and the like. The GPU is a microprocessor for image processing, and is connected to the display screen 194 and the application processor. The GPU is used to perform mathematical and geometric calculations for graphics rendering. Processor 110 may include one or more GPUs that execute program instructions to generate or alter display information.

Display screen 194 is used to display images, videos, and the like. Display screen 194 includes a display panel. The display panel can be a liquid crystal display (LCD), an organic light-emitting diode (OLED), an active-matrix organic light-emitting diode or an active-matrix organic light-emitting diode (active-matrix organic light). emitting diode, AMOLED), flexible light-emitting diode (flex light-emitting diode, FLED), Miniled, MicroLed, Micro-oLed, quantum dot light-emitting diode (quantum dot light emitting diodes, QLED) and so on. In some examples, terminal 100 may include one or more display screens 194 . In one example, the display screen 194 may be used to display an interface of an application, display a display window of an application, and the like.

The terminal 100 can realize the shooting function through the ISP, the camera 193, the video codec, the GPU, the display screen 194 and the application processor.

The ISP is used to process the data fed back by the camera 193 . For example, when shooting, the shutter is opened, the light is transmitted to the photosensitive element of the camera through the lens, the light signal is converted into an electrical signal, and the photosensitive element of the camera transmits the electrical signal to the ISP for processing, and converts it into an image visible to the naked eye. ISP can also perform algorithm optimization on image noise, brightness, and skin tone. ISP can also optimize the exposure, color temperature and other parameters of the shooting scene. In some examples, the ISP may be provided in the camera 193 .

The camera 193 is used to capture still images or videos, for example, to capture facial feature information, posture feature information and the like of a person. The object is projected through the lens to generate an optical image onto the photosensitive element. The photosensitive element may be a charge coupled device (CCD) or a complementary metal oxide semiconductor (Complementary Metal Oxide Semiconductor, CMOS) phototransistor. The photosensitive element converts the optical signal into an electrical signal, and then transmits the electrical signal to the ISP to convert it into a digital image signal. The ISP outputs the digital image signal to the DSP for processing. DSP converts digital image signals into standard RGB, YUV and other formats of image signals. In some examples, terminal 100 may include one or more cameras 193 . Exemplarily, the camera 193 may collect the user's facial features, and transmit the facial features to the processor 110, so that the processor 110 determines the user's attention to part or all of the area on the display screen 4 according to the facial features.

A digital signal processor is used to process digital signals, in addition to processing digital image signals, it can also process other digital signals. For example, when the terminal 100 selects a frequency point, the digital signal processor is used to perform Fourier transform on the energy of the frequency point, and so on.

Video codecs are used to compress or decompress digital video. Terminal 100 may support one or more video codecs. In this way, the terminal 100 can play or record videos in various encoding formats, for example, moving picture experts group (moving picture experts group, MPEG) 1, MPEG2, MPEG3, MPEG4, and so on.

The external memory interface 120 can be used to connect an external memory card, such as a Micro SD card, to expand the storage capacity of the terminal 100. The external memory card communicates with the processor 110 through the external memory interface 120 to realize the data storage function. For example to save files like music, video etc in external memory card.

Internal memory 121 may be used to store computer executable program code, which includes instructions. The processor 110 executes various functional applications and data processing of the terminal 100 by executing the instructions stored in the internal memory 121 . The internal memory 121 may include a storage program area and a storage data area. The storage program area can store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), and the like. The storage data area may store data (such as audio data, phone book, etc.) created during the use of the terminal 100 and the like. In addition, the internal memory 121 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, universal flash storage (UFS), and the like.

The terminal 100 may implement audio functions through an audio module 170, a speaker 170A, a receiver 170B, a microphone 170C, an earphone interface 170D, an application processor, and the like. Such as music playback, recording, etc.

The audio module 170 is used for converting digital audio information into analog audio signal output, and also for converting analog audio input into digital audio signal. Audio module 170 may also be used to encode and decode audio signals. In some examples, the audio module 170 may be provided in the processor 110 , or some functional modules of the audio module 170 may be provided in the processor 110 .

Speaker 170A, also referred to as a "speaker", is used to convert audio electrical signals into sound signals. The terminal 100 can listen to music through the speaker 170A, or listen to a hands-free call.

The receiver 170B, also referred to as "earpiece", is used to convert audio electrical signals into sound signals. When the terminal 100 answers a call or a voice message, the voice can be answered by placing the receiver 170B close to the human ear.

The microphone 170C, also called "microphone" or "microphone", is used to convert sound signals into electrical signals. When making a call or sending a voice message, the user can make a sound by approaching the microphone 170C through a human mouth, and input the sound signal into the microphone 170C. The terminal 100 may be provided with at least one microphone 170C. In other examples, the terminal 100 may be provided with two microphones 170C, which may implement a noise reduction function in addition to collecting sound signals. In other embodiments, the terminal 100 may further be provided with three, four or more microphones 170C to collect sound signals, reduce noise, identify sound sources, and implement directional recording functions.

The earphone jack 170D is used to connect wired earphones. The earphone interface 170D may be the USB interface 130, or may be a 3.5mm open mobile terminal platform (OMTP) standard interface, a cellular telecommunications industry association of the USA (CTIA) standard interface.

The sensor module 180 may include a pressure sensor 180A, a gyro sensor 180B, an air pressure sensor 180C, a magnetic sensor 180D, an acceleration sensor 180E, a distance sensor 180F, a proximity light sensor 180G, a fingerprint sensor 180H, a temperature sensor 180J, a touch sensor 180K, and an ambient light sensor 180L, bone conduction sensor 180M, etc.

The pressure sensor 180A is used to sense pressure signals, and can convert the pressure signals into electrical signals. In some examples, pressure sensor 180A may be provided on display screen 194 . There are many types of pressure sensors 180A, such as resistive pressure sensors, inductive pressure sensors, capacitive pressure sensors, and the like. The capacitive pressure sensor may be comprised of at least two parallel plates of conductive material. When a force is applied to the pressure sensor 180A, the capacitance between the electrodes changes. The terminal 100 determines the intensity of the pressure according to the change in capacitance. When a touch operation acts on the display screen 194, the terminal 100 detects the intensity of the touch operation according to the pressure sensor 180A. The terminal 100 may also calculate the touched position according to the detection signal of the pressure sensor 180A. In some examples, touch operations acting on the same touch position but with different touch operation intensities may correspond to different operation instructions. For example, when a touch operation whose intensity is less than the first pressure threshold acts on the short message application icon, the instruction for viewing the short message is executed. When a touch operation with a touch operation intensity greater than or equal to the first pressure threshold acts on the short message application icon, the instruction to create a new short message is executed.

The gyro sensor 180B may be used to determine the motion attitude of the terminal 100 . In some examples, the angular velocity of terminal 100 about three axes (ie, x, y, and z axes) may be determined by gyro sensor 180B. The gyro sensor 180B can be used for image stabilization. Exemplarily, when the terminal 100 is used to collect user feature information in the environment, the gyro sensor 180B detects the angle at which the terminal 100 shakes, calculates the distance that the lens module needs to compensate for according to the angle, and allows the lens to offset the movement of the terminal 100 through reverse motion. Shake, achieve anti-shake.

The air pressure sensor 180C is used to measure air pressure. In some examples, the terminal 100 calculates the altitude through the air pressure value measured by the air pressure sensor 180C to assist in positioning and navigation.

The acceleration sensor 180E can detect the magnitude of the acceleration of the terminal 100 in various directions (generally three axes). When the terminal 100 is stationary, the magnitude and direction of gravity can be detected. It can also be used to identify the posture of the terminal, and can be used in applications such as horizontal and vertical screen switching, pedometers, etc.

Distance sensor 180F for measuring distance. The terminal 100 can measure the distance through infrared or laser. In some examples, when using the terminal to collect user characteristic information of the user in the environment, the terminal 100 may use the distance sensor 180F to measure the distance to achieve fast focusing.

The ambient light sensor 180L is used to sense ambient light brightness. The terminal 100 can adaptively adjust the brightness of the display screen 194 according to the perceived ambient light brightness.

The fingerprint sensor 180H is used to collect fingerprints. The terminal 100 can use the collected fingerprint characteristics to unlock the fingerprint, access the application lock, take a picture with the fingerprint, answer the incoming call with the fingerprint, and the like.

The temperature sensor 180J is used to detect the temperature. In some examples, the terminal 100 uses the temperature detected by the temperature sensor 180J to execute a temperature processing strategy. For example, when the temperature reported by the temperature sensor 180J exceeds a threshold value, the terminal 100 reduces the performance of the processor located near the temperature sensor 180J, so as to reduce power consumption and implement thermal protection. In other embodiments, when the temperature is lower than another threshold, the terminal 100 heats the battery 142 to avoid abnormal shutdown of the terminal 100 due to low temperature. In some other embodiments, when the temperature is lower than another threshold, the terminal 100 boosts the output voltage of the battery 142 to avoid abnormal shutdown caused by low temperature.

Touch sensor 180K, also called "touch device". The touch sensor 180K may be disposed on the display screen 194 , and the touch sensor 180K and the display screen 194 form a touch screen, also called a “touch screen”. The touch sensor 180K is used to detect a touch operation on or near it. The touch sensor can pass the detected touch operation to the application processor to determine the type of touch event. Visual output related to touch operations may be provided through display screen 194 . In other embodiments, the touch sensor 180K may also be disposed on the surface of the terminal 100 , which is different from the position where the display screen 194 is located.

The keys 190 include a power-on key, a volume key, an input keyboard, and the like. Keys 190 may be mechanical keys. It can also be a touch key. The terminal 100 may receive key input and generate key signal input related to user settings and function control of the terminal 100 .

Motor 191 can generate vibrating cues. The motor 191 can be used for vibrating alerts for incoming calls, and can also be used for touch vibration feedback. For example, touch operations acting on different applications (such as video playback, audio playback, etc.) may correspond to different vibration feedback effects. The motor 191 can also correspond to different vibration feedback effects for touch operations on different areas of the display screen 194 . Different application scenarios (for example: time reminder, receiving information, alarm clock, games, etc.) can also correspond to different vibration feedback effects. The touch vibration feedback effect can also support customization.

The indicator 192 can be an indicator light, which can be used to indicate the charging state, the change of the power, and can also be used to indicate a message, a missed call, a notification, and the like.

The SIM card interface 195 is used to connect a SIM card. The SIM card can be contacted and separated from the terminal 100 by inserting into the SIM card interface 195 or pulling out from the SIM card interface 195 . The terminal 100 may support 1 or N SIM card interfaces, where N is a positive integer greater than 1. The SIM card interface 195 can support Nano SIM card, Micro SIM card, SIM card and so on. Multiple cards can be inserted into the same SIM card interface 195 at the same time. The types of the plurality of cards may be the same or different. The SIM card interface 195 can also be compatible with different types of SIM cards. The SIM card interface 195 is also compatible with external memory cards. The terminal 100 interacts with the network through the SIM card to realize functions such as calls and data communication. In some embodiments, the terminal 100 employs an eSIM, ie an embedded SIM card. The eSIM card can be embedded in the terminal 100 and cannot be separated from the terminal 100 .

Taking the terminal 100 as a mobile phone as an example below, the technical solutions provided by the present application will be described in detail with reference to the accompanying drawings.

(1) Determine that the state related to the image displayed in the display window of the application on the mobile phone has changed

It is understandable that various types of applications can be installed on the mobile phone, such as games, videos, social media, news and so on. After the user starts the application on the mobile phone, the display window of the application will be displayed on the display screen of the mobile phone, such as the display window 12 in FIG. 1a. On the display window of the application, an image will be displayed, such as the content displayed in the display window 12 in FIG. 1a; wherein, in this solution, the image can be understood as a video, a picture, and the like. In this solution, the application may also be referred to as an application program, software, or the like.

It should be noted that, in this solution, the state related to the image displayed in the display window of the application on the mobile phone may be at least one of the display state of the display window of the application on the mobile phone or the user state of the user currently using the mobile phone. The following descriptions are given by taking the states related to the images displayed in the display window of the application on the mobile phone as the display state and the user state.

a. The state related to the image displayed in the display window of the application on the mobile phone is the display state

In this solution, the display state may include the size of the display window of the application, the content expressed by the image displayed in the display window of the application, and the like.

If the display state is the size of the display window of the application, the mobile phone can determine whether the state related to the image displayed in the display window of the application on the mobile phone has changed by determining whether the size of the display window has changed.

For example, continuing to refer to FIGS. 1a and 1b, when the size of the display window 12 is switched from the size in FIG. 1a to the size in FIG. 1b, it can be determined that the size of the display window has changed, in other words, the display state occurs at this time. changed. Similarly, when the size of the display window 12 is switched from the size in FIG. 1b to the size in FIG. 1a, it can also be determined that the size of the display window has changed, in other words, the display state has changed at this time.

If the display state is the content expressed by the image displayed in the display window of the application, the mobile phone can identify the image in the display window based on neural-network processing units (NPU), etc., or based on the slave server The acquired data determines the content expressed by the image, and then determines whether the content expressed by the image has changed. It can be understood that, in this solution, when the content expressed by the image changes, the type of the content before the change and the type of the content after the change may be different, for example, the content before the change is video content, and the content after the change The content is game content and so on.

For example, continuing to refer to FIG. 2a, the mobile phone can determine that the content displayed on the current display window 14 is the game content based on the data obtained from the server. Continuing to refer to FIG. 2b, the mobile phone can determine that the content displayed on the current display window 14 is video content based on the data obtained from the server. After the display content in the display window 14 is switched from FIG. 2a to FIG. 2b, it can be determined that the content expressed by the image in the display window 14 has changed, that is, the expressed content is switched from game content to video content. Similarly, after the display content in the display window 14 is switched from FIG. 2b to FIG. 2a, it can be determined that the content expressed by the image in the display window 14 has changed, that is, the expressed content is switched from video content to game content.

In addition, when determining whether the content expressed by the image displayed in the display window of the application has changed, the judgment can also be made in combination with the running speed of a graphics processor (Graphics Processing Unit, GPU) in the mobile phone. For example, when the user is playing a game, the GPU runs faster, and when the user watches a video, the GPU runs slowly, so the image displayed in the application's display window can be determined by the GPU's running speed. Whether the content expressed has changed.

b. The state related to the image displayed in the display window of the application on the mobile phone is the user state

In this solution, the user state may include the user's attention to a certain area on the display window, the operation frequency of the user's operation of the mobile phone, and the like.

If the user state is the user's attention to a certain area on the display window, the mobile phone can use the eye tracking technology to collect the user's eye movement state through the image acquisition device such as the camera on the mobile phone, and estimate the position of the user's eye gaze point. After the mobile phone estimates the position of the user's eye gaze point, if the position of the user's eye gaze point is in the area where the display window is located, it can be determined that the user is paying attention to the image displayed on the display window; otherwise, it can be determined that the user is not paying attention. Displays the image displayed on the window. When it is determined that the user is paying attention to the content displayed on the display window, the user's gaze duration can be counted, and then the corresponding degree of attention can be determined according to the time interval to which the user's gaze duration belongs. In this solution, the gaze duration of the user's gaze at the display window may be the gaze duration of the user's gaze at part or all of the area on the display window; in addition, the user's gaze is the user's eye gaze.

For example, continuing to refer to FIG. 3a, the mobile phone can determine that the user M is looking at the displayed content in the display window 15 at this time. Then, the mobile phone can count the gazing duration of the user M's gazing at the display window 15, for example, 10 seconds. If the relationship between the pre-configured duration interval and the degree of attention is: if the fixation duration is 0 to 8s, the degree of attention is level 1; if the fixation duration is 8s to 16s, the degree of attention is level 2; if the fixation duration is greater than 16s, the degree of attention is 3 level; then when the fixation time is 10s, the determined attention degree is level 2. Continue to refer to Fig. 3b, at this time, the mobile phone can determine that the user M is looking at the displayed content in the display window 16, that is, it can be determined that the user M no longer pays attention to the display window 15, and the user is paying attention to the display window 15 at this time. Can be 0. When the eyeball of the user M is switched from gazing at the display window 15 to gazing at the display window 16 , it can be determined that the user's attention to a certain area on the display window 15 has changed. Similarly, when the eyeball of the user M is switched from gazing at the display window 16 to gazing at the display window 15 , it can be determined that the user's attention to a certain area on the display window 16 has changed.

If the user status is the operating frequency of the user operating the mobile phone, the mobile phone can count the frequency of the operating instructions issued by the user to determine the operating frequency of the user operating the mobile phone, and then determine whether the operating frequency has changed. Exemplarily, when the operating frequency of the user operating the mobile phone is high, the user is often in a game state; and when the operating frequency of the user operating the mobile phone is low, the user is often in the state of watching videos.

For example, continue to refer to FIGS. 2a and 2b , in FIG. 2a the user is in a game state, and the user's finger will frequently touch the display screen of the mobile phone 11 . In FIG. 2b, however, the user is in the state of watching the game video, and the frequency of the user's finger touching the display screen of the mobile phone 11 is very low. When the operating frequency of the user operating the mobile phone is switched from the operating frequency in FIG. 2a to the operating frequency in FIG. 2b, it can be determined that the operating frequency of the user operating the mobile phone has changed. Similarly, when the operating frequency of the user operating the mobile phone is switched from the operating frequency in FIG. 2b to the operating frequency in FIG. 2a, it can also be determined that the operating frequency of the user operating the mobile phone has changed.

It should be noted that, for the convenience of description, the state related to the image displayed in the display window before the change is called the first state, and the state related to the image displayed in the display window after the change is called the second state. state.

(2) Determine the parameters required for the mobile phone to output an image in the second state

After the state related to the image displayed in the display window of the application on the mobile phone changes, the mobile phone can determine the parameters required for outputting the image in the display window in the second state, wherein the required parameters for outputting the image may include image quality , at least one of frame rate or resolution.

Exemplarily, if the second state is a state after the size of the display window of the application is changed, the mobile phone may, according to the size of the display window after the change, and the mapping relationship between the size of the display window and the resolution that can be displayed, Determine the resolution that the changed display window can display.

If the second state is the state after the content expressed by the image displayed in the display window of the application is changed, the mobile phone can determine the output image in the second state according to the mapping relationship between the pre-calibrated content and the parameters required to output the image required parameters. For example, when the content expressed by the image in the display window is game content, the image quality, frame rate and resolution can all be level 1; when the content expressed by the image in the display window is video content, the image quality, frame rate and resolution The resolutions can all be level 2; among them, the display effect of level 1 is stronger than that of level 2.

If the second state is the state after the user's attention to an area on the display window has changed, the mobile phone can determine the output image in the second state according to the mapping relationship between the pre-calibrated attention and the parameters required for outputting the image required parameters. For example, when the degree of attention is level 1, the image quality, frame rate, and resolution may all be level 1; when the degree of attention is level 2, the image quality, frame rate, and resolution may all be level 2.

If the second state is a state after the operating frequency of the user operating the mobile phone is changed, the mobile phone can determine the parameters required for outputting the image in the second state according to the mapping relationship between the pre-calibrated operating frequency and the parameters required for outputting the image. For example, when the operating frequency is level 1, the image quality, frame rate and resolution can all be level 1; when the operating frequency is level 2, the image quality, frame rate and resolution can all be level 2.

For the acquisition method of the second parameter, reference may be made to the acquisition method of the first parameter, which will not be repeated here.

It should be noted that, for the convenience of description, the parameters of the mobile phone outputting the image displayed in the display window in the first state are referred to as the second parameter, and the parameters of the mobile phone outputting the image displayed in the display window in the second state are referred to as the second parameter. is the first parameter. The first parameter and the second parameter are of the same type.

(3) Determine whether the deviation between the first parameter and the second parameter is greater than a preset difference

By mathematically calculating the first parameter and the second parameter, the deviation value between the two can be determined. Among them, the deviation value can be a difference value, a ratio value and so on. Exemplarily, when the first parameter and the second parameter are both resolutions, if the first parameter is 1080p and the second parameter is 720p, the difference between the two is 1080-720=360; When the two parameters are both frame rates, if the first parameter is 60 Hz and the second parameter is 30 Hz, the difference between the two is 60-30=30.

It can be understood that, in order to facilitate the calculation of the deviation value, the parameter values of the first parameter and the second parameter may be calibrated to different values, and then the deviation value is calculated. For example, when the first parameter and the second parameter are both resolutions, if the first parameter is 1080p and the second parameter is 720p, then 1080p can be calibrated as number 10, and 720p can be calibrated as number 7. The difference is 10-7=3; when the first parameter and the second parameter are both frame rates, if the first parameter is 60Hz and the second parameter is 30Hz, 1080p can be calibrated as a number 10, and 720p can be calibrated as a number 7. At this time, the difference between the two is 10-7=3.

In addition, when both the first parameter and the second parameter are image quality, both the first parameter and the second parameter may be represented by numerical values instead. For example, the first parameter may be 100, the second parameter may be 80, and so on.

Further, after determining the deviation value between the first parameter and the second parameter, comparing the deviation value with the preset difference value, the magnitude relationship between the deviation value and the preset difference value can be determined.

Wherein, if the deviation value is less than or equal to the preset difference value, it indicates that the deviation between the first parameter and the second parameter is small, and at this time, the performance of the terminal when outputting an image with the first parameter and outputting an image with the second parameter is almost the same , so the terminal can continue to output the image with the second parameter at this time.

If the deviation value is greater than the preset difference value, it indicates that the deviation between the first parameter and the second parameter is relatively large. At this time, if the terminal continues to output images with the second parameter, the terminal is likely to continue to run with high performance or low performance. Therefore, at this time, the terminal can adjust the second parameter to the first parameter, and then output the image with the first parameter.

(4) Adjust the second parameter to the first parameter

After it is determined that the deviation value between the first parameter and the second parameter is relatively large, the second parameter may be adjusted to the first parameter. Among them, the first parameter is the parameter of the image displayed in the display window output by the mobile phone in the second state, and the second parameter is the parameter of the image displayed in the display window of the mobile phone in the first state; the first state is the same as before the change. A state related to the image displayed in the display window, and the second state is a changed state related to the image displayed in the display window.

The following describes how to adjust the second parameter to the first parameter, respectively, for the second parameter greater than the first parameter and the second parameter less than the first parameter.

The first and second parameters are greater than the first parameter

If the second parameter is greater than the first parameter, it indicates that the display effect of the image displayed in the display window is reduced after the state change related to the image displayed in the display window. At this time, the second parameter can be adjusted to the first parameter in the following manner.

a. Reduce at least one of the operating frequency of the processor in the mobile phone that processes the image displayed in the display window or the operating voltage of the power domain to which the processor belongs. For example, the video post-processing performance of the decoder in the mobile phone can be reduced (for example, the working clock of the logic is reduced, etc.), the matching voltage of the decoder in the mobile phone can be reduced, and the like.

b. Reduce the number of image processing algorithms that process the image displayed in the display window. In this solution, the image processing algorithms can include contour removal (De Contour, DC), mosquito noise removal (De Mosquito, DM), halo noise removal (De Ring, DR), motion estimation and compensation (Motion Estimate and Motion Compensation, MEMC), noise reduction (Noise Reduction, NR), image super-resolution (Super Resolution, SR), and other algorithms. For example, if four image processing algorithms are used when outputting the image in the display window with the second parameter, namely MEMC, DC, NR, SR, then when outputting the image in the display window with the first parameter, you can use 2 image processing algorithms, such as NR, SR.

c. If the first parameter and the second parameter are frame rates, the video stream corresponding to the image in the display window can be dropped to adjust the second parameter to the first parameter. The frame dropping method may be a video pre-processing (Video Process Sub-System, VPSS) frame dropping method.

d. If the first parameter and the second parameter are resolutions, the resolution of the data source requested by the application in the mobile phone to be obtained from the server can be switched from the second parameter to the first parameter, in other words, in the display window of the application in the mobile phone. The data source of the image is switched from the data source of the resolution of the second parameter to the data source of the resolution of the first parameter. For example, continuing to refer to FIG. 1a and FIG. 1b, if the resolution of the display window 12 in FIG. 1a is 1080p, and the resolution of the display window 12 in FIG. 1b is 720p, then in FIG. 720p original image data, that is, the film source of the application to which the switch display window 12 belongs.

Second, the second parameter is smaller than the first parameter

If the second parameter is smaller than the first parameter, it indicates that the display effect of the image displayed in the display window is improved after a state change related to the image displayed in the display window. At this time, the second parameter can be adjusted to the first parameter in the following manner.

a. Increase at least one of the operating frequency of the image processor displayed in the processing display window in the mobile phone or the operating voltage of the power supply domain to which the processor belongs. For example, the video post-processing performance of the decoder in the mobile phone can be improved (for example, the working clock of the logic can be improved, etc.), and the matching voltage of the decoder in the mobile phone can be improved.

b. Increase the number of image processing algorithms that process the image displayed in the display window. In this solution, the image processing algorithms can include contour removal (De Contour, DC), mosquito noise removal (De Mosquito, DM), halo noise removal (De Ring, DR), motion estimation and compensation (Motion Estimate and Motion Compensation, MEMC), noise reduction (Noise Reduction, NR), image super-resolution (Super Resolution, SR), and other algorithms. For example, if two image processing algorithms, NR and SR, are used when outputting the image in the display window with the second parameter, then four image processing algorithms can be used when outputting the image in the display window with the first parameter , such as MEMC, DC, NR, SR. Exemplarily, continue to refer to Fig. 2a and Fig. 2b, if the image processing algorithm for processing the image in the display window 14 in Fig. 2b is NR, SR, then the display state in the display window 14 is switched from the video playback state in Fig. 2b to Fig. In the game state in 2a, the number of image processing algorithms for the images in the display window 14 can be increased in FIG. 2a, such as adding MEMC and DC algorithms, so that the processing algorithms for the images in the display window 14 in FIG. 2a are MEMC, DC, NR. , SR.

c. If the first parameter and the second parameter are frame rates, frame supplementation may be performed on the video stream corresponding to the image in the display window to adjust the second parameter to the first parameter. Among them, the frame supplementation method may be a motion estimation compensation (Motion Estimate and Motion Compensation, MEMC) frame supplementation method.

d. If the first parameter and the second parameter are resolutions, the resolution of the data source requested by the application in the mobile phone to be obtained from the server can be switched from the second parameter to the first parameter, in other words, in the display window of the application in the mobile phone. The data source of the image is switched from the data source of the resolution of the second parameter to the data source of the resolution of the first parameter. For example, continue referring to FIG. 1a and FIG. 1b, if the resolution of the display window 12 in FIG. 1b is 720p, and the resolution of the display window 12 in FIG. 1a is 1080p, then in FIG. The 1080p original image data, that is, the film source of the application to which the switching display window 12 belongs.

It can be understood that when the second parameter is greater than the first parameter, it can indicate that the user's attention to the image displayed in the display window of the application is reduced. At this time, the user may be paying attention to other areas on the display screen of the mobile phone. Therefore, at this time, the number of image processing algorithms for images in other areas on the display screen of the mobile phone can be increased, so as to present the images in other areas to the user with a better display effect and improve user experience. 3a and 3b, after the user's line of sight is switched from FIG. 3a to FIG. 3b, an image processing algorithm for processing the images in the display window 16 can be added; for example, in FIG. 3a, the processing display window 16 There are two processing algorithms for the images in FIG. 3 , such as NR and SR. In FIG. 3 b , there are four processing algorithms for processing the images in the display window 16 , such as MEMC, DC, NR, and SR.

Similarly, when the second parameter is smaller than the first parameter, it can indicate that the user's attention to the image displayed in the display window of the application is improved. Therefore, at this time, the number of image processing algorithms for images in other areas on the display screen of the mobile phone can be reduced, so as to reduce the power consumption of the mobile phone. 3a and 3b, after the user's line of sight is switched from FIG. 3a to FIG. 3b, the image processing algorithm for processing the images in the display window 15 can be reduced; for example, in FIG. 3a, the processing display window 15 There are four processing algorithms for the images in FIG. 3 , such as MEMC, DC, NR, and SR. In FIG. 3 b , there are two processing algorithms for processing the images in the display window 15 , such as NR and SR.

It can be understood that, when adjusting the second parameter to the first parameter, the adjustment value of each parameter that needs to be adjusted in the mobile phone can be determined based on the deviation value between the two. Exemplarily, there may be a mapping relationship between the deviation value and the adjustment value, and after the deviation value is determined, the adjustment value may be determined. For example, Table 1 shows the mapping relationship between the deviation value and the adjustment value. When the deviation value is determined to be A1, the adjustment value can be determined to be B1.

Table I

偏差值Deviation	调整值Adjustment value
A1A1	B1B1
A2A2	B2B2
A3A3	B3B3

For example, when it is necessary to adjust the operating voltage of the power supply domain of the processor that processes the image displayed in the display window in the mobile phone, the adjustment value can be determined according to the deviation value between the second parameter and the first parameter, thereby determining Output the operating voltage of the power domain to which the processor belongs after adjustment. After that, you can adjust the working voltage of the power domain to which the processor belongs.

Next, the flow steps of a terminal control method provided by an embodiment of the present application are introduced.

Please refer to FIG. 5, which is a schematic flowchart of a terminal control method provided by an embodiment of the present application. It can be understood that the method can be performed by any apparatus, device, platform, or device cluster with computing and processing capabilities. As shown in Figure 5, the terminal control method includes:

Step S101, it is determined that the target state is switched from the first state to the second state.

In this solution, the target state may include at least one of the display state of the display window of the first application on the terminal or the user state of the user currently using the terminal, wherein the display window of the first application displays the first image.

When the target state is the display state, the terminal, a component on the terminal, or other equipment may monitor the display state of the display window of the first application on the terminal to determine whether the display state changes. 1a and 1b, when the state of the display window 12 is switched from the state in FIG. 1a to the state in FIG. 1b, it can be determined that the display state of the display window 12 has changed.

When the target state is the user state, the terminal, a component on the terminal, or other equipment may also monitor the user state to determine whether the user state changes. Exemplarily, referring to FIG. 3a and FIG. 3b, when the user state is switched from the state in FIG. 3a to the state in FIG. 3b, it can be determined that the user state has changed.

In one example, the display state may include at least one of the size of the display window and the target content expressed by the first image; the user state may include the user's target attention to the first area on the display window, and the first area is used for Part or all of the first image is displayed, and at least one of a target operation frequency for the user to operate the terminal.

Wherein, if the display state is the size of the display window, after it is determined that the size of the display window is switched from the first size to the second size, it can be determined that the target state is switched from the first state to the second state. Wherein, the first size is different from the second size.

If the display state is the target content expressed by the first image, after it is determined that the target content expressed by the first image is switched from the first content to the second content, it can be determined that the target state is switched from the first state to the second state . Wherein, the types of the first content and the second content are different.

If the user state is the user's target attention to the first area on the display window, after it is determined that the target attention is switched from the first attention to the second attention, it can be determined that the target state is switched from the first state to the second state. The first degree of attention is different from the second degree of attention. For the manner of determining the degree of attention, please refer to the above description.

If the user state is the target operating frequency of the user operating the terminal, after determining that the target operating frequency is switched from the first operating frequency to the second operating frequency, it can be determined that the target state is switched from the first state to the second state. Wherein, the first operating frequency is different from the second operating frequency.

Step S102: Determine the first parameter required by the terminal to output the first image in the second state.

Specifically, after the target state changes, the first parameter required by the terminal to output the first image in the second state can be determined. Wherein, the first parameter may include at least one of image quality, frame rate or resolution. Exemplarily, there is a mapping relationship between the second state and the first parameter, and after it is determined that the target state is switched to the second state, the first parameter can be determined according to the second state. In addition, the first parameter may also be determined by perception of the terminal system, and reference may also be made to the above related description.

Step S103: Adjust the second parameter to the first parameter, the second parameter is a parameter corresponding to when the terminal outputs the first image in the first state, and the first parameter and the second parameter are of the same type.

Specifically, after the first parameter is determined, the corresponding parameter (ie, the second parameter) when the terminal outputs the first image in the first state can be adjusted to the first parameter, so that the terminal outputs the first image with the first parameter , so that the running state of the terminal matches at least one of the display state of the display window or the user state, preventing the terminal from running with high performance or low performance continuously, and helping to solve the problem that the power consumption of the terminal increases or the display effect fails. Meet user needs and other issues to improve user experience. Wherein, in this solution, the types of the first parameter and the second parameter may be the same, that is, when the first parameter is image quality, the second parameter is also image quality; when the first parameter is frame rate, the second parameter is also Frame rate; when the first parameter is resolution, the second parameter is also resolution. For the acquisition method of the second parameter, please refer to the acquisition method of the first parameter.

As a possible implementation manner, the second parameter can be adjusted to the first parameter in the following manner.

a. If the second parameter is greater than the first parameter, at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs can be reduced, and the processor is used to process the first image; if the second parameter is less than the first parameter A parameter can increase at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs.

b. If the second parameter is greater than the first parameter, the first image can be processed with the first number of first image processing algorithms, wherein when the first image is output with the second parameter, the number of the first image processing algorithms is the second number, the first number is less than the second number; if the second parameter is less than the first parameter, the first image can be processed with a third number of the first image processing algorithm, and the third number is greater than the second number.

c. If the second parameter is greater than the first parameter, the image in the second area can be processed by a fourth number of second image algorithms, and the second area is at least part of the display area on the terminal except the area occupied by the display window, wherein , when the first image is output with the second parameter, the number of the second image processing algorithm is the fifth number, and the fourth number is greater than the fifth number; if the second parameter is less than the first parameter, the sixth number of the second image can be used The algorithm processes the images in the second region, the sixth quantity being smaller than the fifth quantity.

d. The first parameter may include a frame rate; wherein, if the second parameter is greater than the first parameter, the frame rate at which the terminal outputs the first image in the first state may be dropped; if the second parameter is smaller than the first parameter, Then the frame rate at which the terminal outputs the first image in the first state can be supplemented.

e. The first parameter may include resolution; then when the terminal sends the first request to the server, the resolution of the original image data carried in the first request may be switched from the first resolution to the second resolution, and the first resolution The rate is the resolution at which the terminal outputs the first image in the first state, the second resolution is the resolution required for the terminal to output the first image in the second state, and the first request is used to request the acquisition of data related to the first image. raw image data.

It should be noted that, the above-mentioned manner of adjusting the second parameter to the first parameter may be implemented independently, or may be implemented jointly, which is not limited herein.

It can be understood that, for some or all of the descriptions in the method provided in this solution, reference may be made to the above related descriptions, which will not be repeated here.

Therefore, in this solution, after it is determined that the state related to the image displayed in the display window of the application on the terminal changes, the parameters required by the terminal to output the image displayed in the display window in the changed state are determined, and Based on this parameter, the parameters of the image displayed in the output display window of the terminal are adjusted to prevent the terminal from running with high performance or low performance continuously. user experience.

In one example, before adjusting the second parameter to the first parameter, a deviation value between the two can also be determined, and then based on the deviation value, it is determined whether to adjust the second parameter to the first parameter to avoid unnecessary to improve the accuracy of parameter adjustment. Specifically, as shown in Figure 6, the following steps are included:

Step S201: Determine the deviation value between the first parameter and the second parameter.

Wherein, the first parameter and the second parameter are mathematically calculated to determine the deviation value between the two. In this solution, the deviation value may be a difference value, a ratio value, or the like.

Step S202, judging whether the deviation value is less than or equal to the preset difference value.

Wherein, by comparing the deviation value with the preset difference value, it can be determined whether the deviation value is greater than the preset difference value. In this solution, if the deviation value is less than or equal to the preset difference value, step S203 is executed; otherwise, step S204 is executed.

Step S203, do not adjust the second parameter.

Specifically, if the deviation value is less than or equal to the preset difference value, it indicates that the deviation between the first parameter and the second parameter is relatively small, and at this time, the performance of the terminal when outputting an image with the first parameter and outputting an image with the second parameter is different There are few, so the terminal can continue to output the image with the second parameter at this time, that is, the second parameter is not adjusted at this time.

Step S204, adjusting the second parameter to the first parameter.

Specifically, if the deviation value is greater than the preset difference value, it indicates that the deviation between the first parameter and the second parameter is relatively large. At this time, if the terminal continues to output the image with the second parameter, the terminal is likely to continue to output images with high performance or low performance. Therefore, at this time, the second parameter can be adjusted to the first parameter, so that the terminal outputs the image with the first parameter.

Next, the flow steps of another terminal control method provided by the embodiment of the present application are introduced.

Please refer to FIG. 7 , which is a schematic flowchart of a terminal control method provided by an embodiment of the present application. It can be understood that the method can be performed by any apparatus, device, platform, or device cluster with computing and processing capabilities. As shown in Figure 7, the terminal control method includes:

Step S301, determining that the target state is switched from the first state to the second state, and the target state includes at least one of the display state of the display window of the first application on the terminal or the user state of the user currently using the terminal, wherein the first application The first image is displayed on the display window of . For the description of this step, reference may be made to the description in step S101 above, which will not be repeated here.

Step S302: Adjust target parameters in the terminal, where the target parameters are related to the display effect of the first image.

In this solution, after the target state changes, the target parameters in the terminal can be adjusted to adjust the display effect of the first image, thereby preventing the terminal from continuously running with high performance or low performance. Wherein, adjusting the target parameters in the terminal may include one or more of the following methods:

a. Reduce at least one of the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs, and the processor is used to process the first image; or, increase the operating frequency of the processor in the terminal or the operating voltage of the power domain to which the processor belongs. At least one of the working voltages.

b. Increase the number of first image processing algorithms, where the first image processing algorithm is used to process the first image; or, reduce the number of first image processing algorithms.

c. In the case of increasing the number of the first image processing algorithm, reduce the number of the second image processing algorithm, and the second image processing algorithm is used to process the image in at least part of the display area except the area occupied by the display window on the terminal; Where the number of first image processing algorithms is reduced, the number of second image processing algorithms is increased.

d. When the target parameter includes the frame rate, frame dropping may be performed on the video stream corresponding to the first image, or frame supplementation may be performed on the video stream corresponding to the first image.

e. When the target parameter includes the resolution, the resolution of the original image data related to the first image carried in the first request can be adjusted when the terminal sends the first request to the server, and the first request is used to request the acquisition of the original image data.

f. When the target parameter includes the first parameter corresponding to the first image in the first state, the second parameter corresponding to the first image in the second state may be determined first, and the second parameter is of the same type as the first parameter; Then, the first parameter is adjusted according to the first parameter and the second parameter.

In one example, adjusting the first parameter according to the first parameter and the second parameter may include: when there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter; or when the first parameter is different from the second parameter When the deviation value between the second parameters is greater than the preset difference value, the first parameter is adjusted based on the deviation value so that the deviation value is smaller than or equal to the preset difference value.

Based on the methods in the foregoing embodiments, the embodiments of the present application provide a terminal control apparatus. Please refer to FIG. 8. FIG. 8 is a schematic structural diagram of a terminal control apparatus provided by an embodiment of the present application. As shown in FIG. 8 , the terminal control apparatus 800 includes: a determination module 81 and a processing module 82; wherein, the determination module 81 is used to determine that the target state is switched from the first state to the second state, and the target state includes the first application on the terminal. At least one of the display state of the display window or the user state of the user currently using the terminal, and the first image is displayed on the display window of the first application; the processing module 82 is used to adjust the target parameter in the terminal, and the target parameter is the same as the first image. It is related to the display effect of an image.

In an example, the target state includes the display state, and the display state includes the size of the display window; the determining module 81 is specifically configured to: determine that the size of the display window is switched from the first size to the second size.

In one example, the target state includes a display state, and the display state includes the target content expressed by the first image; the determining module 81 is specifically configured to: determine that the target content is switched from the first content to the second content, and the type of the first content is the same as that of the first content. The type of the second content is different.

In one example, the target state includes a user state, and the user state includes the user's target attention to the first area on the display window, and the first area is used to display part or all of the first image; the determining module 81 is specifically configured to: determine The target attention degree is switched from the first attention degree to the second attention degree.

In one example, the determining module 81 is specifically configured to: determine the gaze duration during which the user's eyeballs gaze at the first region, and determine the target attention degree according to the duration interval to which the gaze duration belongs.

In one example, the target state includes a user state, and the user state includes a target operating frequency of the user operating the terminal; the determining module 81 is specifically configured to: determine that the target operating frequency is switched from the first operating frequency to the second operating frequency.

In an example, the processing module 82 is specifically configured to: reduce at least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs, and the processor is used to process the first image; or increase the processor in the terminal at least one of the operating frequency of the processor or the operating voltage of the power domain to which the processor belongs.

In one example, the processing module 82 is specifically configured to: increase the number of the first image processing algorithms, where the first image processing algorithm is used to process the first image; or reduce the number of the first image processing algorithms.

In an example, when the number of the first image processing algorithms is increased, the processing module 82 is further configured to: reduce the number of the second image processing algorithms, and the second image processing algorithm is used to process the area on the terminal except the area occupied by the display window At least part of the image outside the display area; or, in the case of reducing the number of the first image processing algorithms, the processing module 82 is further configured to: increase the number of the second image processing algorithms.

In one example, the target parameter includes frame rate;

The processing module 82 is specifically configured to: drop frames on the video stream corresponding to the first image, or perform frame supplementation on the video stream corresponding to the first image.

In one example, the target parameter includes resolution;

The processing module 82 is specifically configured to: when the terminal sends the first request to the server, adjust the resolution of the original image data related to the first image carried in the first request, and the first request is used for requesting to obtain the original image data.

In one example, the target parameter includes a first parameter corresponding to the first image in the first state; the processing module 82 is further configured to: determine a second parameter corresponding to the first image in the second state, and the second parameter is the same as the first parameter. One parameter is of the same type; the first parameter is adjusted according to the first parameter and the second parameter.

In one example, the processing module 82 is further configured to: when there is a deviation between the first parameter and the second parameter, adjust the first parameter to the second parameter; or when the deviation value between the first parameter and the second parameter is greater than When the difference value is preset, based on the deviation value, the first parameter is adjusted so that the deviation value is less than or equal to the preset difference value.

It should be understood that the above-mentioned apparatus is used to execute the method in the above-mentioned embodiment, and the implementation principle and technical effect of the corresponding program modules in the apparatus are similar to those described in the above-mentioned method, and the working process of the apparatus may refer to the corresponding program module in the above-mentioned method The process will not be repeated here.

Based on the methods in the foregoing embodiments, the embodiments of the present application provide an electronic device. Please refer to FIG. 9 , which is a schematic structural diagram of an electronic device provided by an embodiment of the present application. As shown in FIG. 9 , the electronic device provided by the embodiment of the present application can be used to implement the method described in the foregoing method embodiment.

The electronic device includes at least one processor 901, and the at least one processor 901 can support the electronic device to implement the methods provided in the embodiments of this application.

The processor 901 may be a general-purpose processor or a special-purpose processor. For example, the processor 901 may include a central processing unit (CPU) and/or a baseband processor. The baseband processor may be used for processing communication data (for example, determining a target screen terminal), and the CPU may be used for implementing corresponding control and processing functions, executing software programs, and processing data of software programs.

Further, the electronic device may further include a transceiver unit 905 to implement signal input (reception) and output (send). For example, the transceiver unit 905 may include a transceiver or a radio frequency chip. Transceiver unit 905 may also include a communication interface.

Optionally, the electronic device may further include an antenna 906, which may be used to support the transceiver unit 905 to implement the transceiver function of the electronic device.

Optionally, the electronic device may include one or more memories 902 on which programs (or instructions or codes) 904 are stored, and the program 904 may be executed by the processor 901, so that the processor 901 executes the above method embodiments. method described. Optionally, data may also be stored in the memory 902 . Optionally, the processor 901 can also read the data stored in the memory 902 (for example, the pre-stored first feature information), the data can be stored in the same storage address as the program 904, and the data can also be stored with the program 904 at different storage addresses.

The processor 901 and the memory 902 can be provided separately, or can be integrated together, for example, integrated on a single board or a system on chip (system on chip, SOC).

For a detailed description of the operations performed by the electronic device in the above-mentioned various possible designs, reference may be made to the descriptions in the embodiments of the methods provided in the embodiments of the present application, and details are not repeated here.

Based on the apparatuses in the foregoing embodiments, the embodiments of the present application further provide another electronic device, where the electronic equipment includes the terminal control apparatus 800 provided in the foregoing embodiments.

Based on the methods in the foregoing embodiments, an embodiment of the present application further provides a terminal control apparatus. Please refer to FIG. 10 , which is a schematic structural diagram of another terminal control apparatus provided by an embodiment of the present application. As shown in FIG. 10 , the terminal control apparatus 1000 includes one or more processors 1001 and an interface circuit 1002 . Optionally, the terminal control apparatus 1000 may further include a bus 1003 . in:

The processor 1001 may be an integrated circuit chip with signal processing capability. In the implementation process, each step of the above-mentioned method can be completed by an integrated logic circuit of hardware in the processor 1001 or an instruction in the form of software. The above-mentioned processor 1001 may be a general purpose processor, a digital communicator (DSP), an application specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components . Various methods and steps disclosed in the embodiments of this application can be implemented or executed. A general purpose processor may be a microprocessor or the processor may be any conventional processor or the like.

The interface circuit 1002 can be used for sending or receiving data, instructions or information. The processor 1001 can use the data, instructions or other information received by the interface circuit 1002 to process, and can send the processing completion information through the interface circuit 1002.

Optionally, the terminal control apparatus 1000 further includes a memory, which may include a read-only memory and a random access memory, and provides operation instructions and data to the processor. A portion of the memory may also include non-volatile random access memory (NVRAM).

Optionally, the memory stores executable software modules or data structures, and the processor may execute corresponding operations by calling operation instructions stored in the memory (the operation instructions may be stored in the operating system).

Optionally, the interface circuit 1002 may be used to output the execution result of the processor 1001 .

It should be noted that the corresponding functions of the processor 1001 and the interface circuit 1002 can be implemented by hardware design, software design, or a combination of software and hardware, which is not limited here.

It should be understood that, each step of the above method embodiments may be implemented by a logic circuit in the form of hardware or an instruction in the form of software in a processor.

It can be understood that, the processor in the embodiments of the present application may be a central processing unit (central processing unit, CPU), and may also be other general-purpose processors, digital signal processors (digital signal processors, DSP), application-specific integrated circuits (application specific integrated circuit, ASIC), field programmable gate array (field programmable gate array, FPGA) or other programmable logic devices, transistor logic devices, hardware components or any combination thereof. A general-purpose processor may be a microprocessor or any conventional processor.

The method steps in the embodiments of the present application may be implemented in a hardware manner, or may be implemented in a manner in which a processor executes software instructions. Software instructions can be composed of corresponding software modules, and software modules can be stored in random access memory (RAM), flash memory, read-only memory (ROM), programmable read-only memory (programmable rom) , PROM), erasable programmable read-only memory (erasable PROM, EPROM), electrically erasable programmable read-only memory (electrically EPROM, EEPROM), registers, hard disks, removable hard disks, CD-ROMs or known in the art in any other form of storage medium. An exemplary storage medium is coupled to the processor, such that the processor can read information from, and write information to, the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and storage medium may reside in an ASIC.

In the above-mentioned embodiments, it may be implemented in whole or in part by software, hardware, firmware or any combination thereof. When implemented in software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of the present application are generated. The computer may be a general purpose computer, special purpose computer, computer network, or other programmable device. The computer instructions may be stored in or transmitted over a computer-readable storage medium. The computer instructions can be sent from one website site, computer, server, or data center to another website site by wire (eg, coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (eg, infrared, wireless, microwave, etc.) , computer, server or data center. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server, a data center, or the like that includes an integration of one or more available media. The usable media may be magnetic media (eg, floppy disks, hard disks, magnetic tapes), optical media (eg, DVDs), or semiconductor media (eg, solid state disks (SSDs)), and the like.

It can be understood that, the various numbers and numbers involved in the embodiments of the present application are only for the convenience of description, and are not used to limit the scope of the embodiments of the present application.

Claims

A terminal control method, characterized in that the method comprises:

It is determined that the target state is switched from the first state to the second state, and the target state includes at least one of the display state of the display window of the first application on the terminal or the user state of the user currently using the terminal, wherein the A first image is displayed on the display window of the first application;

A target parameter in the terminal is adjusted, where the target parameter is related to the display effect of the first image.
The method according to claim 1, wherein the target state comprises the display state, and the display state comprises the size of the display window;

The determining that the target state is switched from the first state to the second state includes:

It is determined that the size of the display window is switched from the first size to the second size.
The method according to claim 1 or 2, wherein the target state includes the display state, and the display state includes the target content expressed by the first image;

The determining that the target state is switched from the first state to the second state includes:

It is determined that the target content is switched from first content to second content, and the type of the first content is different from the type of the second content.
The method according to any one of claims 1-3, wherein the target state includes the user state, the user state includes the user's target attention to the first area on the display window, and the first an area for displaying part or all of the first image;

The determining that the target state is switched from the first state to the second state includes:

It is determined that the target attention degree is switched from the first attention degree to the second attention degree.
The method according to claim 4, wherein the method further comprises:

determining the gazing duration of the user's eyeball gazing at the first region;

The target attention degree is determined according to the time interval to which the gaze time length belongs.
The method according to any one of claims 1-5, wherein the target state includes the user state, and the user state includes a target operation frequency of the user operating the terminal;

The determining that the target state is switched from the first state to the second state includes:

It is determined that the target operating frequency is switched from the first operating frequency to the second operating frequency.
The method according to any one of claims 1-6, wherein the adjusting the target parameter in the terminal comprises:

reducing at least one of an operating frequency of a processor in the terminal or an operating voltage of a power domain to which the processor belongs, where the processor is configured to process the first image;

or

At least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs is increased.
The method according to any one of claims 1-7, wherein the adjusting the target parameter in the terminal comprises:

increasing the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image;

or

Reduce the number of the first image processing algorithms.
The method according to claim 8, wherein in the case of increasing the number of the first image processing algorithms, the method further comprises:

reducing the number of second image processing algorithms, the second image processing algorithms being used to process images in at least part of the display area on the terminal except the area occupied by the display window;

In the case of reducing the number of the first image processing algorithms, the method further includes:

Increase the number of said second image processing algorithms.
The method according to any one of claims 1-9, wherein the target parameter comprises a frame rate;

The adjusting the target parameter related to the first image in the terminal includes:

Frame dropping is performed on the video stream corresponding to the first image, or frame complementing is performed on the video stream corresponding to the first image.
The method according to any one of claims 1-10, wherein the target parameter includes the resolution;

The adjusting the target parameter related to the first image in the terminal includes:

When the terminal sends a first request to the server, adjust the resolution of the original image data related to the first image carried in the first request, where the first request is used to request to obtain the original image data .
The method according to any one of claims 1-11, wherein the target parameter comprises a first parameter corresponding to the first image in the first state;

The adjusting the target parameter related to the first image in the terminal includes:

determining a second parameter corresponding to the first image in the second state, where the second parameter is of the same type as the first parameter;

The first parameter is adjusted according to the first parameter and the second parameter.
The method according to claim 12, wherein the adjusting the first parameter according to the first parameter and the second parameter comprises:

When there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter;

or

When the deviation value between the first parameter and the second parameter is greater than a preset difference value, the first parameter is adjusted based on the deviation value, so that the deviation value is less than or equal to the preset value difference.
A terminal control device, characterized in that the device comprises:

A determination module, configured to determine that a target state is switched from the first state to the second state, where the target state includes at least one of the display state of the display window of the first application on the terminal or the user state of the user currently using the terminal , wherein a first image is displayed on the display window of the first application;

A processing module, configured to adjust target parameters in the terminal, where the target parameters are related to the display effect of the first image.
The apparatus of claim 14, wherein the target state includes the display state, and the display state includes a size of the display window;

The determining module is also used for:

It is determined that the size of the display window is switched from the first size to the second size.
The device according to claim 14 or 15, wherein the target state includes the display state, and the display state includes the target content expressed by the first image;

The determining module is also used for:

It is determined that the target content is switched from first content to second content, and the type of the first content is different from the type of the second content.
The device according to any one of claims 14-16, wherein the target state includes the user state, the user state includes a user's target attention to the first area on the display window, and the first an area for displaying part or all of the first image;

The determining module is also used for:

It is determined that the target attention degree is switched from the first attention degree to the second attention degree.
The apparatus according to claim 17, wherein the determining module is further configured to:

determining the gazing duration of the user's eyeball gazing at the first region;

The target attention degree is determined according to the time interval to which the gaze time length belongs.
The apparatus according to any one of claims 14-18, wherein the target state includes the user state, and the user state includes a target operation frequency of the user operating the terminal;

The determining module is also used for:

It is determined that the target operating frequency is switched from the first operating frequency to the second operating frequency.
The device according to any one of claims 14-19, wherein the processing module is further configured to:

reducing at least one of an operating frequency of a processor in the terminal or an operating voltage of a power domain to which the processor belongs, where the processor is configured to process the first image;

or

At least one of the operating frequency of the processor in the terminal or the operating voltage of the power supply domain to which the processor belongs is increased.
The device according to any one of claims 14-20, wherein the processing module is further configured to:

increasing the number of first image processing algorithms, wherein the first image processing algorithms are used to process the first image;

or

Reduce the number of the first image processing algorithms.
The apparatus according to claim 21, wherein, when the number of the first image processing algorithms is increased, the processing module is further configured to:

reducing the number of second image processing algorithms, the second image processing algorithms being used to process images in at least part of the display area on the terminal except the area occupied by the display window;

In the case of reducing the number of the first image processing algorithms, the processing module is further configured to:

Increase the number of said second image processing algorithms.
The apparatus according to any one of claims 14-22, wherein the target parameter includes a frame rate;

The processing module is also used for:

Frame dropping is performed on the video stream corresponding to the first image, or frame complementing is performed on the video stream corresponding to the first image.
The apparatus according to any one of claims 14-23, wherein the target parameter comprises the resolution;

The processing module is also used for:

When the terminal sends a first request to the server, adjust the resolution of the original image data related to the first image carried in the first request, where the first request is used to request to obtain the original image data .
The apparatus according to any one of claims 14-24, wherein the target parameter includes a first parameter corresponding to the first image in the first state;

The processing module is also used for:

determining a second parameter corresponding to the first image in the second state, where the second parameter is of the same type as the first parameter;

The first parameter is adjusted according to the first parameter and the second parameter.
The device according to claim 25, wherein the processing module is further configured to:

When there is a deviation between the first parameter and the second parameter, adjusting the first parameter to the second parameter;

or

When the deviation value between the first parameter and the second parameter is greater than a preset difference value, the first parameter is adjusted based on the deviation value, so that the deviation value is less than or equal to the preset value difference.
An electronic device, comprising:

at least one memory for storing programs;

At least one processor for invoking a program stored in the memory to execute the method according to any one of claims 1-13.
A computer storage medium, in which instructions are stored, when the instructions are executed on a computer, the instructions cause the computer to execute the method according to any one of claims 1-13.
A computer program product comprising instructions which, when executed on a computer, cause the computer to perform the method of any of claims 1-13.
A terminal control device, characterized in that it includes at least one processor and an interface;

The at least one processor obtains program instructions or data through the interface;

The at least one processor is adapted to execute the program line instructions to implement the method of any of claims 1-13.