CN115185362A - Electronic device control method, electronic device control device, storage medium and electronic device - Google Patents

Electronic device control method, electronic device control device, storage medium and electronic device Download PDF

Info

Publication number
CN115185362A
CN115185362A CN202110357593.7A CN202110357593A CN115185362A CN 115185362 A CN115185362 A CN 115185362A CN 202110357593 A CN202110357593 A CN 202110357593A CN 115185362 A CN115185362 A CN 115185362A
Authority
CN
China
Prior art keywords
electronic device
encoding
complexity
image
electronic equipment
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110357593.7A
Other languages
Chinese (zh)
Inventor
赵娟萍
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Guangdong Oppo Mobile Telecommunications Corp Ltd
Original Assignee
Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Guangdong Oppo Mobile Telecommunications Corp Ltd filed Critical Guangdong Oppo Mobile Telecommunications Corp Ltd
Priority to CN202110357593.7A priority Critical patent/CN115185362A/en
Priority to PCT/CN2022/073903 priority patent/WO2022206153A1/en
Publication of CN115185362A publication Critical patent/CN115185362A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • G06F1/3203—Power management, i.e. event-based initiation of a power-saving mode
    • G06F1/3234—Power saving characterised by the action undertaken
    • G06F1/329—Power saving characterised by the action undertaken by task scheduling
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F1/00—Details not covered by groups G06F3/00 - G06F13/00 and G06F21/00
    • G06F1/26—Power supply means, e.g. regulation thereof
    • G06F1/32—Means for saving power
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
    • Y02D—CLIMATE CHANGE MITIGATION TECHNOLOGIES IN INFORMATION AND COMMUNICATION TECHNOLOGIES [ICT], I.E. INFORMATION AND COMMUNICATION TECHNOLOGIES AIMING AT THE REDUCTION OF THEIR OWN ENERGY USE
    • Y02D10/00—Energy efficient computing, e.g. low power processors, power management or thermal management

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)

Abstract

The application discloses an electronic equipment control method, an electronic equipment control device, a storage medium and electronic equipment. The electronic equipment control method comprises the following steps: acquiring operating parameters of the electronic equipment; if the operation parameter meets a preset condition, the complexity of the encoding operation performed by the electronic device is reduced, and the operation parameter meeting the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application. The power consumption and the heat generation of the electronic equipment can be reduced.

Description

Electronic device control method, electronic device control device, storage medium and electronic device
Technical Field
The present application belongs to the technical field of electronic devices, and in particular, to an electronic device control method, apparatus, storage medium, and electronic device.
Background
With the development of technology, more and more components are configured in electronic devices. For example, the components related to Image Processing include a Central Processing Unit (CPU), an Image Signal Processor (ISP), a Neural-Network Processing Unit (NPU), a Graphics Processing Unit (GPU), and the like. However, when the electronic device operates these components, the electronic device consumes much power and generates heat.
Disclosure of Invention
The embodiment of the application provides an electronic device control method, an electronic device control device, a storage medium and an electronic device, which can reduce the power consumption and heat generation of the electronic device.
In a first aspect, an embodiment of the present application provides an electronic device control method, including:
acquiring operating parameters of the electronic equipment;
if the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic device, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
In a second aspect, an embodiment of the present application provides an electronic device control apparatus, including:
the acquisition module is used for acquiring the operating parameters of the electronic equipment;
a processing module, configured to reduce complexity of a coding operation performed by the electronic device if the operation parameter meets a preset condition, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limit on power consumption, a state requiring a limit on heat generation, and a state requiring allocation of at least one application among a set of system resources.
In a third aspect, an embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is caused to execute a flow in an electronic device control method provided in an embodiment of the present application.
In a fourth aspect, an embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to execute the flow in the electronic device control method provided in the embodiment of the present application by calling the computer program stored in the memory.
In this embodiment, the electronic device may first obtain the operating parameter. Then, if it is detected that the operating parameter of the electronic device satisfies the preset condition, the electronic device may reduce the complexity of performing the encoding operation. The condition that the operation parameter satisfies the preset condition may indicate that the electronic device is in at least one of the following states: a state requiring a limit on power consumption, a state requiring a limit on heat generation, and a state requiring allocation of at least one application among a set of system resources. Since the encoding operation may cause higher power consumption and device heating, the embodiment of the present application may reduce the complexity of the encoding operation when the electronic device is in at least one of the three states, that is, the state in which power consumption needs to be limited, the state in which heating needs to be limited, and the state in which system resources need to be collectively allocated to at least one application, so that the embodiment of the present application may reduce power consumption and heating of the electronic device.
Drawings
The technical solutions and advantages of the present application will become apparent from the following detailed description of specific embodiments of the present application when taken in conjunction with the accompanying drawings.
Fig. 1 is a first flowchart illustrating an electronic device control method according to an embodiment of the present application.
Fig. 2 is a second flowchart of an electronic device control method according to an embodiment of the present application.
Fig. 3 is a schematic flowchart of a third method for controlling an electronic device according to an embodiment of the present disclosure.
Fig. 4 is a fourth flowchart of an electronic device control method according to an embodiment of the present application.
Fig. 5 is a fifth flowchart illustrating an electronic device control method according to an embodiment of the present application.
Fig. 6 is a sixth flowchart of an electronic device control method according to an embodiment of the present application.
Fig. 7 is a seventh flowchart of an electronic device control method according to an embodiment of the present application.
Fig. 8 is an eighth flowchart of an electronic device control method according to an embodiment of the present application.
Fig. 9 is a ninth flowchart illustrating an electronic device control method according to an embodiment of the present application.
Fig. 10 is a tenth flowchart illustrating an electronic device control method according to an embodiment of the present application.
Fig. 11 is an eleventh flowchart illustrating an electronic device control method according to an embodiment of the present application.
Fig. 12 to 14 are scene schematic diagrams of an electronic device control method provided in an embodiment of the present application.
Fig. 15 is a schematic structural diagram of an electronic device control apparatus according to an embodiment of the present application.
Fig. 16 is a schematic structural diagram of an electronic device according to an embodiment of the present application.
Fig. 17 is another schematic structural diagram of an electronic device according to an embodiment of the present application.
Detailed Description
Referring to the drawings, wherein like reference numbers refer to like elements, the principles of the present application are illustrated as being implemented in a suitable computing environment. The following description is based on illustrated embodiments of the application and should not be taken as limiting the application with respect to other embodiments that are not detailed herein.
It is understood that the execution subject of the embodiment of the present application may be an electronic device such as a smart phone or a tablet computer. The electronic device may be any device that includes an encoder, such as a video encoder.
Referring to fig. 1, fig. 1 is a schematic flowchart of a first process of an electronic device control method according to an embodiment of the present application, where the process may include:
101. and acquiring the operating parameters of the electronic equipment.
With the development of technology, more and more components are configured in electronic devices. For example, the components related to Image Processing include a Central Processing Unit (CPU), an Image Signal Processor (ISP), a Neural-Network Processing Unit (NPU), a Graphics Processing Unit (GPU), and the like. However, when the electronic device operates these components, the electronic device consumes much power and generates heat.
In the embodiment of the present application, for example, before or during the encoding operation performed by the electronic device, the electronic device may acquire the operating parameter.
In some embodiments, the encoding operations may include video encoding and the like.
After the operation parameters of the electronic device are acquired, the electronic device may detect whether the operation parameters satisfy preset conditions.
If the operating parameters are detected not to meet the preset conditions, the electronic equipment can continue to perform the encoding operation according to the current mode.
If the operating parameters are detected to satisfy the predetermined conditions, the process flow 102 may be entered.
102. If the operation parameter meets a preset condition, the complexity of the encoding operation performed by the electronic equipment is reduced, and the condition that the operation parameter meets the preset condition indicates that the electronic equipment is in at least one of the following states: a state requiring a limit on power consumption, a state requiring a limit on heat generation, and a state requiring allocation of at least one application among a set of system resources.
For example, if the electronic device detects that the operation parameter satisfies the preset condition, the electronic device may reduce the complexity of performing the encoding operation. The condition that the operating parameter of the electronic device satisfies the preset condition may indicate that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
For example, the electronic device detects that the electronic device is in a low power state according to the operation parameter, that is, the electronic device is in a state that power consumption needs to be limited. In this case, the electronic device may reduce the complexity of performing the encoding operation.
For another example, the electronic device detects that the electronic device is in a state of high heat generation according to the operation parameter, that is, the electronic device is in a state of needing to limit heat generation. In this case, the electronic device may reduce the complexity of performing the encoding operation.
For another example, the electronic device detects that the electronic device is in a state where power and computational resources need to be allocated to a certain application or module in a centralized manner according to the operating parameters. In this case, the electronic device may reduce the complexity of performing the encoding operation.
It can be understood that, in the embodiment of the present application, the electronic device may first acquire the operating parameter. Then, if it is detected that the operating parameter of the electronic device satisfies the preset condition, the electronic device may reduce the complexity of performing the encoding operation. The condition that the operation parameter meets the preset condition can indicate that the electronic equipment is in at least one of the following states: a state requiring a limit on power consumption, a state requiring a limit on heat generation, and a state requiring allocation of at least one application among a set of system resources. Since the encoding operation may cause higher power consumption and device heating, and the embodiment of the present application may reduce the complexity of the encoding operation when the electronic device is in at least one of the three states, that is, the state in which power consumption needs to be limited, the state in which heating needs to be limited, and the state in which system resources need to be collectively allocated to at least one application, the embodiment of the present application may reduce power consumption and heating of the electronic device.
In one embodiment, the process of acquiring the operating parameters of the electronic device may include: and acquiring a residual electric quantity value of the electronic equipment.
Then, if the operation parameter satisfies the preset condition, the process of reducing the complexity of the encoding operation performed by the electronic device may include: and if the residual electric quantity value is smaller than the first threshold value, reducing the complexity of the coding operation of the electronic equipment, wherein the fact that the electronic equipment is in a state that the electric quantity consumption needs to be limited is indicated by the fact that the residual electric quantity value is smaller than the first threshold value.
For example, before or during the encoding operation, the electronic device may obtain a residual electric quantity value thereof, and detect whether the residual electric quantity value is smaller than the first threshold.
If the remaining power value is detected to be greater than or equal to the first threshold value, the power of the electronic device can be considered to be sufficient. In this case, the electronic device may continue to perform the encoding operation in the current manner.
If the remaining power value is detected to be smaller than the first threshold, the electronic device may be considered to be in a power shortage state, that is, the electronic device is in a state in which power consumption needs to be limited. In this case, the electronic device may reduce the complexity of the encoding operation, thereby saving power by reducing the complexity of the encoding operation. Since the complexity of the encoding operation can be reduced to reduce the workload of the devices related to the encoding operation, the heat generation of these devices can be reduced, and the heat generation of the entire electronic apparatus can be reduced.
In another embodiment, the process of acquiring the operating parameters of the electronic device may include: the temperature of the electronic device is acquired.
Then, if the operation parameter satisfies a preset condition, the process of reducing the complexity of the encoding operation performed by the electronic device may include: and if the temperature of the electronic equipment is greater than a second threshold value, the complexity of the coding operation performed by the electronic equipment is reduced, wherein the temperature greater than the second threshold value indicates that the electronic equipment is in a state that the heating is required to be limited.
For example, before or during the encoding operation, the electronic device may obtain a temperature of the at least one component and detect whether the temperature is greater than the second threshold.
If the temperature is detected to be less than or equal to the second threshold, the temperature of the electronic device may be deemed low. In this case, the electronic device may continue to perform the encoding operation in the current manner.
If it is detected that the temperature is greater than the second threshold, it may be determined that the electronic device is in a state in which heat generation is severe, that is, the electronic device is in a state in which heat generation needs to be limited. In this case, the electronic device may reduce the complexity of the encoding operation, so as to reduce the workload of the devices related to the encoding operation by reducing the complexity of the encoding operation, and thus achieve the effect of reducing the overall heat generation of the electronic device by reducing the heat generation of the devices. In addition, reducing the workload of the components associated with the encoding operation may also save power for the electronic device.
It should be noted that, in the embodiment of the present application, the temperature acquired by the electronic device may be the temperature of at least one of the following components: a battery, a dynamic random access memory controller DRAM, a central processing unit CPU, a graphics processing unit GPU, a neural network processor NPU, an image signal processor ISP, a digital signal processor DSP, an electronic device shell and the like.
In yet another embodiment, the electronic device may set different priorities for different applications in advance. Wherein, higher priority of the application may indicate that the application has higher demand on system resources (such as power, computational resources, etc.).
Based on this, the process of obtaining the operating parameters of the electronic device may include: the priority of the applications running in the electronic device is obtained.
Then, if the operation parameter satisfies a preset condition, the process of reducing the complexity of the encoding operation performed by the electronic device may include: and if a second application with higher priority than the first application exists in the running applications, reducing the complexity of the encoding operation performed by the electronic equipment, wherein the first application is the application performing the encoding operation, and the second application with higher priority than the first application exists in the running applications, which indicates that the electronic equipment is in a state that the system resources are required to be allocated to the second application in a centralized manner.
For example, at time T1, the electronic device is running a first application that performs an encoding operation. And at the time T2 after a period of time, the electronic equipment starts to run the second application. Wherein the priority of the second application is higher than the priority of the first application. Since the second application has a higher priority than the first application, the second application may be considered to have a higher demand for system resources than the first application, and the electronic device may be in a state that requires allocation of system resources to the second application in the set. In this case, the electronic device may reduce the complexity of the encoding operation, thereby reducing power consumption and device heating by reducing the complexity of the encoding operation and leaving more power and computational resources for the second application.
Referring to fig. 2, fig. 2 is a schematic flow chart of a control method of an electronic device according to an embodiment of the present application, where the flow chart includes:
201. and acquiring the operating parameters of the electronic equipment.
For example, the electronic device may obtain the operating parameters before or during the encoding operation.
Thereafter, the electronic device may detect whether its operating parameters satisfy a preset condition. The condition that the operating parameter of the electronic device satisfies the preset condition may indicate that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can continue to perform the coding operation according to the current mode.
If the operating parameters are detected to satisfy the predetermined conditions, then the process flow of 202 may be entered.
202. If the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic equipment by using a first type of operation, wherein the condition that the operation parameter meets the preset condition indicates that the electronic equipment is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a distribution of a set of system resources to at least one application, the first type of operation comprising at least one of: reducing the number of reference frames when performing motion estimation, increasing the merge level when performing motion estimation, compressing to I-frames, compressing to P-frames of a single reference frame, compressing to non-referenced frames.
For example, if the electronic device detects that its operating parameters satisfy a predetermined condition, the electronic device may use the first type of operation to reduce the complexity of performing the encoding operation. Wherein the first type of operation may include at least one of: reducing the number of reference frames when motion estimation is performed, increasing the merging level when motion estimation is performed, compressing into I-frames, compressing into P-frames of a single reference frame, compressing into non-referenced frames.
It should be noted that reducing the number of reference frames during Motion Estimation (ME) can increase the number of frames that need not be referred to, because the electronic device will not write the reconstructed pixel data of the frames that need not be referred to into a Dynamic Random Access Memory (DRAM). Therefore, reducing the number of reference frames reduces the power consumption of the DRAM, and the reconstructed frame DMA does not need to be operated, and the power consumption is reduced by the number of seeks. It will be appreciated that the overall heat generation of the electronic device may also be reduced, since reducing the workload of the motion estimation ME may reduce the heat generation of the relevant components.
Increasing the Merge Level (Merge Level) when performing motion estimation may enable the electronic device to save a portion of the energy of motion estimation. The compression into I-frames may allow the electronics to completely omit the energy of motion estimation. The adaptation of a P frame to a single reference frame may result in the electronic device only needing to expend the energy of motion estimation once. The compression to be unreferenced frames may allow the electronic device to save the energy of entropy coding. It can be understood that, since the above operation can reduce the workload of the related components and the battery discharge while saving the power consumption of the electronic device, thereby reducing the heat generation of the related components and the battery, the overall heat generation of the electronic device can also be reduced.
It should be noted that the first type of operation may refer to an operation performed on the image Frame (Frame) level to reduce the encoding complexity. That is, the first type of operation belongs to a frame-level or Slice-level operation. In addition to the above-listed operations, the present embodiment is not specifically limited and listed, as the operations for reducing the encoding complexity that can be performed on the image frame level belong to the first type of operations.
In one implementation, the embodiments of the present application may further include:
before encoding each image frame, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining first encoding parameters for the image frame by using a first type of operation;
encoding each image block in the image frame by using the first encoding parameter until each image block in the image frame is encoded;
or, before encoding each image slice, if it is detected that the operating parameters of the electronic device satisfy a preset condition, determining second encoding parameters for the image slice by using a first type of operation;
and encoding each image block in the image slice by using the second encoding parameter until each image block in the image slice is encoded.
For example, before encoding each image frame, the electronic device may detect whether its operating parameters satisfy a predetermined condition.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can carry out coding operation according to the current mode.
If the operating parameter is detected to satisfy the preset condition, the electronic device may determine a first encoding parameter for reducing encoding complexity for the image frame using a first type of operation. Then, the electronic device may encode each image block in the image frame by using the first encoding parameter until each image block in the image frame is encoded. The above-described process may be as shown in fig. 3.
Alternatively, before encoding each image Slice (Slice), the electronic device may detect whether its operating parameters satisfy preset conditions.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can carry out coding operation according to the current mode.
If it is detected that the operational parameters satisfy the preset condition, the electronic device may determine a second encoding parameter for reducing encoding complexity for the image slice using the first type of operation. Then, the electronic device may encode each image block in the image slice by using the second encoding parameter until each image block in the image slice is encoded, and the above process may be as shown in fig. 4.
It is understood that the operating parameters of the electronic device may change from time to time. For example, the power of the electronic device at this moment is still lower than the first threshold, but at the next moment, the user may have quickly charged the electronic device, so that the power of the electronic device is no longer lower than the first threshold. In this case, the operating parameters of the electronic device may change from meeting the preset conditions to no longer meeting the preset conditions. Therefore, the electronic device can detect whether the operation parameters of the electronic device meet the preset conditions before each image frame or image slice is coded, and decide whether the coding complexity needs to be reduced according to the detection result. Therefore, the embodiment of the application can adaptively determine whether the encoding complexity needs to be reduced according to the actual operating parameters of the electronic device.
In some embodiments, before encoding each image frame, a process of encoding a frame header (FrameHeader) to obtain a corresponding code stream may also be included. After all the image blocks in the image frame are encoded, a post-processing (PostProcessing) process may be further included to the code stream obtained after the frame header is encoded. The above-described process may be as shown in fig. 5.
In some embodiments, before encoding each image slice, a flow of encoding a slice header (SliceHeader) to obtain a corresponding code stream may be further included. After all the image blocks in the image slice are coded, the method can also comprise a flow of post-processing the code stream obtained after the slice header is coded. The above-described process may be as shown in fig. 6.
Referring to fig. 7, fig. 7 is a seventh flowchart illustrating an electronic device control method according to an embodiment of the present application, where the flowchart may include:
301. and acquiring the operating parameters of the electronic equipment.
For example, the electronic device may obtain the operating parameters before or during the encoding operation.
The electronic device may then detect whether its operating parameters satisfy a predetermined condition. The condition that the operating parameter of the electronic device satisfies the preset condition may indicate that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can continue to perform the coding operation according to the current mode.
If the operating parameters are detected to satisfy the predetermined conditions, the process flow 302 may be entered.
302. If the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic equipment by using a second type of operation, wherein the condition that the operation parameter meets the preset condition indicates that the electronic equipment is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring allocation of a set of system resources to at least one application, the second type of operation comprising at least one of: in the mode comparison loop, the shape of the comparison block is reduced, the comparison of frequency domain conversion and inverse conversion types is reduced, the inter prediction mode is reduced, the intra prediction mode is reduced, and the prediction number of the block is reduced.
For example, if the electronic device detects that its operating parameters satisfy a predetermined condition, the electronic device may use a second type of operation to reduce the complexity of performing the encoding operation. Wherein the second type of operation may include at least one of: in the mode comparison loop, the shape of the comparison block is reduced, the comparison of frequency domain conversion and inverse conversion types is reduced, the inter prediction mode is reduced, the intra prediction mode is reduced, and the prediction number of the block is reduced.
It should be noted that the mode comparison loop in the video encoder is a large power consumption and heat source. A Mode comparison loop (ComparisonLoop) composed of a Forward Transform and Quantization (FTQ), a reverse Quantization and Transform (De-Quantization & inv. Transform, DQIT), a picture Block region Reconstruction (Block Reconstruction, blkRec), an Intra Prediction (Intra Prediction, intra p), an Intra Block Copy (Intra bc), a Motion Compensation (Motion Compensation, MC), a Mode Decision (Mode Decision, MD) and the like can compare and refer to various Prediction Block sizes, prediction modes, transform Block sizes, transform Block modes, and the like. Since the conversion circuit involved in the mode comparison loop consumes very much power, the embodiments of the present application can effectively reduce power consumption and heat generation by at least one of the following operations: in the mode comparison loop, the shape of the comparison block is reduced, the comparison of frequency domain conversion and inverse conversion types is reduced, the inter prediction mode is reduced, the intra prediction mode is reduced, and the prediction number of the block is reduced.
It should be noted that the second type of operation may refer to an operation performed on the layer of image blocks (blocks) to reduce the encoding complexity. That is, the second type of operation belongs to a Block (Block) level operation. In addition to the operations listed above, the operations that can be performed on the image block level to reduce the encoding complexity all belong to the second type of operations, and this embodiment is not specifically limited to this one.
In one embodiment, when performing the encoding operation, all the encoded image blocks within the same image frame may use the same encoding parameters, or all the encoded image blocks within the same image slice may use the same encoding parameters.
It can be understood that, the same encoding parameters are used for all the image blocks to be encoded in the same image frame or the same image slice, which can greatly reduce the workload of encoding operation and reduce the operation burden of the electronic device, thereby greatly reducing the power consumption and heat generation of the electronic device.
In another embodiment, if the electronic device determines the encoding parameters for each image block separately, the encoding parameters are controlled to remain unchanged during the encoding of the image block after determining the encoding parameters for the image block to be encoded during the encoding operation.
For example, in video coding, a video is composed of a plurality of image frames (frames), and each image Frame is composed of a plurality of image blocks (blocks). Each image frame may comprise at least one image slice, each image slice in turn may comprise a plurality of image blocks. In video encoding, an electronic device encodes each image Block (Block) in each image frame. In this embodiment, if the electronic device determines the encoding parameters for each image block individually, the encoding parameters are controlled to remain unchanged when the image block is encoded after determining the encoding parameters for the image block to be encoded.
For example, the electronic device reduces the complexity of the encoding operation by reducing the number of operations of the pattern comparison loop. For example, when an image block is encoded without reducing the complexity of the encoding operation, the number of operations of the mode comparison circuit is 8. When the operation parameters are detected to meet the preset conditions, the operation times of the mode comparison loop can be reduced from 8 times to 4 times when the electronic equipment encodes the image block, so that the effect of reducing the complexity of the encoding operation of the electronic equipment is achieved. After the number of operations of the pattern comparison circuit is determined to be 4 for the image block to be encoded, the number of operations of the pattern comparison circuit is kept unchanged for 4 times when the image block is encoded, and the number of operations is not suddenly changed to 5 times or 3 times, and the like. In this way, the workload of the electronic device mode comparison circuit is reduced, thereby achieving the effect of reducing the power consumption and heat generation of the electronic device.
In one implementation, the embodiments of the present application may include:
before each image block in the image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining third coding parameters for the image block by using a second type of operation;
and encoding the image block by using the third encoding parameter.
For example, in the case of using the second type of operation to reduce the encoding complexity, the electronic device may detect whether its operating parameters satisfy a preset condition before encoding each image block in each image frame.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can carry out coding operation according to the current mode.
If the operating parameters are detected to satisfy the preset condition, the electronic device may determine, for the image block, a third encoding parameter for reducing encoding complexity using a second type of operation. The electronic device may then encode the image block using the third encoding parameter without changing the encoding parameter. The above-described process may be as shown in fig. 8.
It is understood that the operating parameters of the electronic device may change from time to time. For example, the power of the electronic device at this moment is still lower than the first threshold, but at the next moment, the user may quickly charge the electronic device, so that the power of the electronic device is no longer lower than the first threshold. In this case, the operating parameters of the electronic device may change from meeting the preset conditions to no longer meeting the preset conditions. Therefore, the electronic device may detect whether the operating parameters of the electronic device satisfy the preset condition before encoding each image block in the image frame, and determine whether to reduce the encoding complexity according to the detection result. Therefore, the embodiment of the application can adaptively determine whether the encoding complexity needs to be reduced according to the actual operating parameters of the electronic device.
In some embodiments, before encoding each image frame, a process of encoding a frame header (FrameHeader) or a slice header (SliceHeader) to obtain a corresponding code stream may also be included. After all the image blocks in the image frame are coded, the method also can comprise a flow of post-processing the code stream obtained after the frame header or the slice header is coded. The above-described flow may be as shown in fig. 9.
In another implementation, the embodiment of the present application may further include the following process:
if the complexity of the encoding operation is reduced by using the first type of operation and the second type of operation, detecting whether the operating parameters of the electronic equipment meet preset conditions before encoding each image frame;
if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fourth encoding parameters for the image frames by using the first type of operation;
before each image block in the image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fifth coding parameters for the image block by using the second type of operation;
and encoding the image block by using the fourth encoding parameter and the fifth encoding parameter.
For example, the electronic device may use the first type of operation and the second type of operation simultaneously to reduce the complexity of the encoding operation, i.e., the electronic device may reduce the complexity of the encoding operation at the image frame/slice level and at the image block level simultaneously.
Based on this, before encoding each image frame, the electronic device may first detect whether its operating parameters satisfy a preset condition.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can carry out coding operation according to the current mode. For example, the electronic device does not reduce encoding complexity.
If it is detected that the operating parameter meets a preset condition, the electronic device may first determine a fourth encoding parameter for the image frame to be encoded using a first type of operation. After the fourth encoding parameter used in the image frame level is determined, before each image block in the image frame to be encoded is encoded, the electronic device may further detect whether the operating parameter of the electronic device meets the preset condition. If it is detected that the operating parameters thereof still satisfy the preset conditions, the electronic device may determine fifth encoding parameters for the image block using a second type of operation. The electronic device may then encode the image block using the fourth encoding parameter and the fifth encoding parameter. The above process may be as shown in fig. 10.
For example, before encoding the image frame a, the electronic device may first detect whether its operating parameters satisfy a preset condition.
If the operation parameters are detected not to meet the preset conditions, the electronic equipment can carry out coding operation according to the current mode. For example, the electronic device does not reduce the encoding complexity.
If it is detected that the operating parameter meets the preset condition, the electronic device may first determine the fourth encoding parameter C1 for the image frame a using the first type of operation.
After determining the fourth encoding parameter used in the image frame level, before encoding the first image block a1 in the image frame a, the electronic device may further detect whether the operating parameter of the electronic device meets the preset condition again. If it is detected that the operating parameters still satisfy the preset conditions, the electronic device may determine the fifth encoding parameters D1 for the image block a1 using the second type of operation. Thereafter, the electronic device may encode the image block a1 using the fourth encoding parameter C1 and the fifth encoding parameter D1.
Then, before encoding the second image block a2 in the image frame a, the electronic device may further detect whether the operating parameter thereof satisfies the preset condition. If it is detected that the operating parameters thereof still satisfy the preset conditions, the electronic device may determine the fifth encoding parameters D2 for the image block a2 using the second type of operation. Thereafter, the electronic device may encode the image block a2 using the fourth encoding parameter C1 and the fifth encoding parameter D2.
That is, the fourth encoding parameter is applicable to the entire image frame currently being encoded, and the fifth encoding parameter is applicable to the image block currently being encoded in the image frame.
In some embodiments, before encoding each image frame, a process of encoding a frame header (FrameHeader) or a slice header (SliceHeader) to obtain a corresponding code stream may further be included. After all the image blocks in the image frame are coded, the method also can comprise a flow of post-processing the code stream obtained after the frame header or the slice header is coded. The above process may be as shown in fig. 11.
In one embodiment, the electronic device may decide whether to use the first type of operation to reduce the encoding complexity or the second type of operation to reduce the encoding complexity or both the first type of operation and the second type of operation to reduce the encoding complexity according to the current computing power.
For example, when the computing power of the electronic device is less than the third threshold, that is, the computing power of the electronic device is poor, only the first type of operation may be used to reduce the encoding complexity. For example, in a case that the computing capability of the electronic device is poor, when the electronic device performs an encoding operation, all the image blocks to be encoded within the same image frame use the same encoding parameters, or all the image blocks to be encoded within the same image slice use the same encoding parameters.
When the computing power of the electronic device is greater than or equal to the third threshold and less than the fourth threshold, i.e., the computing power of the electronic device is medium, the first type of operation and the second type of operation may be used simultaneously to reduce the encoding complexity. For example, in the case of the electronic device having a moderate arithmetic capability, when the electronic device performs an encoding operation, all of the image blocks to be encoded within the same image frame/image slice use the same encoding parameters, and the electronic device may determine the encoding parameters for each image block and control the encoding parameters to remain unchanged when encoding the image block.
When the computing power of the electronic device is greater than or equal to the fourth threshold, that is, the computing power of the electronic device is strong, only the second type of operation may be used at the same time to reduce the encoding complexity. For example, in a case where the computing power of the electronic device is strong, the electronic device may determine the encoding parameters for each image block individually, and control the encoding parameters to remain unchanged when encoding the image block.
Referring to fig. 12 to 14, fig. 12 to 14 are schematic views of scenes of an electronic device control method according to an embodiment of the present application.
For example, the electronic device starts video encoding at time T3. At time T4, the electronic device detects that the remaining power is lower than the first threshold, that is, the electronic device is in a low power state. At this time, the electronic device may generate a prompt message for prompting the user that the current remaining power is low, as shown in fig. 12. In the case where the electronic device is in a low power state, the electronic device can reduce the complexity of the encoding operation, thereby reducing power consumption and heat generation.
As another example, the electronic device starts video encoding at time T5. At time T6, the electronic device detects that the battery temperature is higher than the second threshold, i.e., the electronic device is in a state where the battery is heated more severely. At this time, the electronic device may generate a prompt message for prompting the user that the current battery temperature is high, as shown in fig. 13. Under the condition that the battery of the electronic equipment generates heat seriously, the electronic equipment can reduce the complexity of coding operation, thereby reducing the power consumption and the heat generation.
For another example, the electronic device starts video encoding at time T7. At time T8, the electronic device detects that the user clicked on gaming application Y, as shown in FIG. 14. Because the game application has higher requirements on system resources, the electronic equipment can reduce the complexity of coding operation, thereby reducing the power consumption and heating, and reserving more power, operation resources and the like for the game application.
Referring to fig. 15, fig. 15 is a schematic structural diagram of an electronic device control apparatus according to an embodiment of the present disclosure. The electronic device control apparatus 300 may include: an acquisition module 301 and a processing module 302.
An obtaining module 301, configured to obtain an operating parameter of an electronic device;
a processing module 302, configured to reduce complexity of the encoding operation performed by the electronic device if the operation parameter meets a preset condition, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
In one embodiment, the obtaining module 301 may be configured to: and acquiring a residual electric quantity value of the electronic equipment.
The processing module 302 may be configured to: and if the residual electric quantity value is smaller than a first threshold value, reducing the complexity of the coding operation of the electronic equipment, wherein the fact that the electronic equipment is in a state of needing to limit the electric quantity consumption is indicated by the fact that the residual electric quantity value is smaller than the first threshold value.
In another embodiment, the obtaining module 301 may be configured to: the temperature of the electronic device is acquired.
The processing module 302 may be configured to: and if the temperature is greater than a second threshold, reducing the complexity of the coding operation of the electronic equipment, wherein the temperature greater than the second threshold indicates that the electronic equipment is in a state in which the heating is required to be limited.
In yet another embodiment, the obtaining module 301 may further be configured to: setting a priority for an application in the electronic device; acquiring the priority of an application running in the electronic equipment;
the processing module 302 may be configured to: if a second application with a higher priority than the first application exists in the running applications, the complexity of the coding operation performed by the electronic equipment is reduced, wherein the first application is an application performing the coding operation, and the second application with the higher priority than the first application exists in the running applications and indicates that the electronic equipment is in a state that the system resource set needs to be allocated to at least one application.
In one embodiment, reducing the complexity of encoding operations performed by the electronic device includes a first type of operation and/or a second type of operation for changing encoding parameters;
wherein the first type of operation comprises at least one of: reducing the number of reference frames when performing motion estimation, increasing the merge level when performing motion estimation, compressing into I-frames, compressing into P-frames of a single reference frame, compressing into non-referenced frames, the first type of operation belonging to a frame-level or slice-level operation;
the second type of operation comprises at least one of: in the mode comparison loop, the shape of the comparison block is reduced, the comparison between the frequency domain conversion and the inverse conversion type is reduced, the inter prediction mode is reduced, the intra prediction mode is reduced, the prediction number of the block is reduced, and the operation of the second type belongs to the operation of block level.
In one embodiment, when performing the encoding operation, all the encoded image blocks within the same image frame use the same encoding parameters, or all the encoded image blocks within the same image slice use the same encoding parameters.
In one embodiment, when performing an encoding operation, after determining encoding parameters for an image block to be encoded, the encoding parameters are controlled to remain unchanged when encoding the image block.
In one embodiment, when the operation for reducing the encoding complexity comprises a first type of operation, the processing module 302 may be configured to:
before encoding each image frame, if the operation parameter of the electronic equipment is detected to meet the preset condition, determining a first encoding parameter for the image frame by using the first type of operation;
encoding each image block in the image frame by using the first encoding parameter until each image block in the image frame is encoded;
or, before encoding each image slice, if it is detected that the operating parameter of the electronic device satisfies the preset condition, determining a second encoding parameter for the image slice by using the first type of operation;
and encoding each image block in the image slice by using the second encoding parameter until each image block in the image slice is encoded.
In another embodiment, when the operation for reducing the encoding complexity comprises an operation of a second type, the processing module 302 may be configured to:
before each image block in an image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining third coding parameters for the image block by using the second type of operation;
and encoding the image block by using the third encoding parameter.
In yet another embodiment, the processing module 302 may be configured to:
if the first type of operation and the second type of operation are used to reduce the complexity of the encoding operation, detecting whether the operating parameters of the electronic device meet the preset conditions before encoding each image frame;
if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fourth encoding parameters for the image frame by using the first type of operation;
before each image block in the image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fifth coding parameters for the image block by using the second type of operation;
and encoding the image block by using the fourth encoding parameter and the fifth encoding parameter.
The embodiment of the present application provides a computer-readable storage medium, on which a computer program is stored, and when the computer program is executed on a computer, the computer is caused to execute the flow in the device control method provided in this embodiment.
The embodiment of the present application further provides an electronic device, which includes a memory and a processor, where the processor is configured to execute the flow in the device control method provided in this embodiment by calling the computer program stored in the memory.
For example, the electronic device may be a mobile terminal such as a tablet computer or a smart phone. Referring to fig. 16, fig. 16 is a schematic structural diagram of an electronic device according to an embodiment of the present disclosure.
The electronic device 400 may include a power supply 401, memory 402, a processor 403, and the like. Those skilled in the art will appreciate that the electronic device configuration shown in fig. 16 is not limiting of electronic devices and may include more or fewer components than shown, or some components may be combined, or a different arrangement of components.
The power source 401 may be used to provide power support for various components and modules of the electronic device, thereby ensuring proper operation of the various components and modules of the electronic device.
The memory 402 may be used to store applications and data. The memory 402 stores applications containing executable code. The application programs may constitute various functional modules. The processor 403 executes various functional applications and data processing by running the application program stored in the memory 402.
The processor 403 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing an application program stored in the memory 402 and calling data stored in the memory 402, thereby performing overall monitoring of the electronic device.
In this embodiment, the processor 403 in the electronic device loads the executable code corresponding to the processes of one or more application programs into the memory 402 according to the following instructions, and the processor 403 runs the application programs stored in the memory 402, so as to execute:
acquiring operating parameters of the electronic equipment;
if the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic device, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
Referring to fig. 17, an electronic device 500 may include a power supply 501, a memory 502, a processor 503, a display 504, a speaker 505, a microphone 506, and the like.
The power source 401 may be used to provide power support for various components and modules of the electronic device, thereby ensuring proper operation of the various components and modules of the electronic device.
The memory 502 may be used to store applications and data. The memory 502 stores applications containing executable code. The application programs may constitute various functional modules. The processor 503 executes various functional applications and data processing by running an application program stored in the memory 502.
The processor 503 is a control center of the electronic device, connects various parts of the whole electronic device by using various interfaces and lines, and performs various functions of the electronic device and processes data by running or executing an application program stored in the memory 502 and calling data stored in the memory 502, thereby integrally monitoring the electronic device.
The display 504 may be used to display information such as text, images, and the like.
Speaker 505 may be used to play sound signals.
Microphone 506 may be used to collect sound signals.
In this embodiment, the processor 503 in the electronic device loads the executable code corresponding to the processes of one or more application programs into the memory 502 according to the following instructions, and the processor 503 runs the application programs stored in the memory 502, so as to execute:
acquiring operating parameters of the electronic equipment;
if the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic device, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
In one embodiment, the processor 503, when executing the acquiring of the operating parameter of the electronic device, may execute: and acquiring a residual electric quantity value of the electronic equipment.
Then, the processor 503 may execute the following steps when the complexity of the encoding operation performed by the electronic device is reduced if the operating parameter satisfies the preset condition: and if the residual electric quantity value is smaller than a first threshold value, reducing the complexity of the coding operation of the electronic equipment, wherein the fact that the electronic equipment is in a state of needing to limit the electric quantity consumption is indicated by the fact that the residual electric quantity value is smaller than the first threshold value.
In one embodiment, the processor 503, when executing the acquiring of the operating parameter of the electronic device, may execute: the temperature of the electronic device is obtained.
Then, when the process 503 executes that if the operation parameter meets the preset condition, and the complexity of the encoding operation performed by the electronic device is reduced, the following steps may be executed: and if the temperature is greater than a second threshold, reducing the complexity of the encoding operation of the electronic equipment, wherein the temperature greater than the second threshold indicates that the electronic equipment is in a state in which the heating is required to be limited.
In one embodiment, the processor 503 may further perform: setting a priority for an application in the electronic device.
Then, the processor 503, when executing the acquiring of the operating parameter of the electronic device, may perform: and acquiring the priority of the application running in the electronic equipment.
The processor 503 may execute the following steps when the complexity of the encoding operation performed by the electronic device is reduced if the operation parameter meets the preset condition: and if a second application with higher priority than the first application exists in the running applications, reducing the complexity of the encoding operation performed by the electronic equipment, wherein the first application is the application performing the encoding operation, and the second application with higher priority than the first application exists in the running applications and indicates that the electronic equipment is in a state that the system resources are required to be allocated to at least one application in a centralized manner.
In one embodiment, the reducing the complexity of the encoding operation by the electronic device comprises a first type of operation and/or a second type of operation for changing an encoding parameter;
wherein the first type of operation comprises at least one of: reducing the number of reference frames when performing motion estimation, increasing the merge level when performing motion estimation, recompressing to I-frames, recompressing to P-frames of a single reference frame, recompressing to non-referenced frames, said first type of operation belonging to a frame-level or slice-level operation;
the second type of operation comprises at least one of: in the mode comparison loop, the second type of operation belongs to block-level operation, comparing block shape, comparing frequency domain conversion with inverse conversion type, reducing inter-prediction mode, reducing intra-prediction mode, and reducing prediction number of blocks.
In one embodiment, when performing the encoding operation, all the encoded image blocks within the same image frame use the same encoding parameters, or all the encoded image blocks within the same image slice use the same encoding parameters.
In one embodiment, when performing an encoding operation, after determining encoding parameters for an image block to be encoded, the encoding parameters are controlled to remain unchanged when encoding the image block.
In one embodiment, when the operation for reducing the encoding complexity comprises a first type of operation, the processor 503 may perform: before encoding each image frame, if the operation parameter of the electronic equipment is detected to meet the preset condition, determining a first encoding parameter for the image frame by using the first type of operation; encoding each image block in the image frame by using the first encoding parameter until each image block in the image frame is encoded; or, before encoding each image slice, if it is detected that the operating parameter of the electronic device satisfies the preset condition, determining a second encoding parameter for the image slice by using the first type of operation; and encoding each image block in the image slice by using the second encoding parameter until each image block in the image slice is encoded.
In one embodiment, when the operation for reducing the encoding complexity comprises an operation of a second type, the processor 503 may perform: before each image block in an image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining third coding parameters for the image block by using the second type of operation; and encoding the image block by using the third encoding parameter.
In one embodiment, the processor 503 may perform: if the first type of operation and the second type of operation are used to reduce the complexity of the encoding operation, detecting whether the operating parameters of the electronic device meet the preset conditions before encoding each image frame; if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fourth encoding parameters for the image frame by using the first type of operation; before each image block in the image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fifth coding parameters for the image block by using the second type of operation; and encoding the image block by using the fourth encoding parameter and the fifth encoding parameter.
In the above embodiments, the descriptions of the respective embodiments have respective emphasis, and parts that are not described in detail in a certain embodiment may refer to the above detailed description of the device control method, and are not described herein again.
The electronic device control apparatus provided in the embodiment of the present application and the electronic device control method in the above embodiment belong to the same concept, and any method provided in the electronic device control method embodiment may be run on the electronic device control apparatus, and a specific implementation process thereof is described in detail in the electronic device control method embodiment, and is not described again here.
It should be noted that, for the electronic device control method described in the embodiment of the present application, it can be understood by those skilled in the art that all or part of the process of implementing the electronic device control method described in the embodiment of the present application may be implemented by controlling related hardware through a computer program, where the computer program may be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor, and during the execution, the process of implementing the embodiment of the device control method may include the process of the embodiment of the device control method described above. The storage medium may be a magnetic disk, an optical disk, a Read Only Memory (ROM), a Random Access Memory (RAM), or the like.
In the electronic device control apparatus according to the embodiment of the present application, each functional module may be integrated into one processing chip, each module may exist alone physically, or two or more modules are integrated into one module. The integrated module can be realized in a hardware mode, and can also be realized in a software functional module mode. The integrated module, if implemented in the form of a software functional module and sold or used as a stand-alone product, may also be stored in a computer readable storage medium, such as a read-only memory, a magnetic or optical disk, or the like.
The foregoing describes in detail an electronic device control method, apparatus, storage medium, and electronic device provided in the embodiments of the present application, and specific examples are applied herein to explain the principles and implementations of the present application, and the descriptions of the foregoing embodiments are only used to help understand the method and core ideas of the present application; meanwhile, for those skilled in the art, according to the idea of the present application, the specific implementation manner and the application scope may be changed, and in summary, the content of the present specification should not be construed as a limitation to the present application.

Claims (13)

1. An electronic device control method, comprising:
acquiring operating parameters of the electronic equipment;
if the operation parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic device, where the condition that the operation parameter meets the preset condition indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
2. The method of claim 1, wherein the obtaining the operating parameters of the electronic device comprises: acquiring a residual electric quantity value of the electronic equipment;
if the operating parameter meets a preset condition, reducing the complexity of the encoding operation of the electronic device, including: and if the residual electric quantity value is smaller than a first threshold value, reducing the complexity of the coding operation of the electronic equipment, wherein the fact that the electronic equipment is in a state of needing to limit the electric quantity consumption is indicated by the fact that the residual electric quantity value is smaller than the first threshold value.
3. The method for controlling the electronic device according to claim 1, wherein the obtaining the operating parameter of the electronic device comprises: acquiring the temperature of the electronic equipment;
if the operating parameter meets a preset condition, reducing the complexity of the encoding operation of the electronic device, including: and if the temperature is greater than a second threshold, reducing the complexity of the encoding operation of the electronic equipment, wherein the temperature greater than the second threshold indicates that the electronic equipment is in a state in which the heating is required to be limited.
4. The electronic device control method according to claim 1, characterized in that the method further comprises: setting a priority for an application in the electronic device;
the acquiring of the operating parameters of the electronic device includes: acquiring the priority of an application running in the electronic equipment;
if the operating parameter meets a preset condition, reducing the complexity of the encoding operation performed by the electronic device, including: and if a second application with higher priority than the first application exists in the running applications, reducing the complexity of the encoding operation performed by the electronic equipment, wherein the first application is the application performing the encoding operation, and the second application with higher priority than the first application exists in the running applications and indicates that the electronic equipment is in a state that the system resources are required to be allocated to at least one application in a centralized manner.
5. The electronic device control method according to any one of claims 1 to 4, wherein the reducing of the complexity of the electronic device performing the encoding operation includes a first type of operation and/or a second type of operation for changing an encoding parameter;
wherein the first type of operation comprises at least one of: reducing the number of reference frames when performing motion estimation, increasing the merge level when performing motion estimation, compressing into I-frames, compressing into P-frames of a single reference frame, compressing into non-referenced frames, the first type of operation belonging to a frame-level or slice-level operation;
the second type of operation comprises at least one of: in the mode comparison loop, the shape of the comparison block is reduced, the comparison between the frequency domain conversion and the inverse conversion type is reduced, the inter prediction mode is reduced, the intra prediction mode is reduced, the prediction number of the block is reduced, and the operation of the second type belongs to the operation of block level.
6. The electronic device control method according to claim 5, wherein in the encoding operation, all the encoded image blocks in the same image frame use the same encoding parameters, or all the encoded image blocks in the same image slice use the same encoding parameters.
7. The electronic device control method according to claim 5, wherein the encoding parameters are controlled to remain unchanged when the image block is encoded after the encoding parameters are determined for the image block to be encoded during the encoding operation.
8. The electronic device control method of claim 5, wherein when the operation for reducing encoding complexity comprises a first type of operation, the method comprises:
before encoding each image frame, if the operation parameter of the electronic equipment is detected to meet the preset condition, determining a first encoding parameter for the image frame by using the first type of operation;
encoding each image block in the image frame by using the first encoding parameter until each image block in the image frame is encoded;
or, before encoding each image slice, if it is detected that the operating parameter of the electronic device satisfies the preset condition, determining a second encoding parameter for the image slice by using the first type of operation;
and encoding each image block in the image slice by using the second encoding parameter until each image block in the image slice is encoded.
9. The electronic device control method of claim 5, wherein when the operation for reducing encoding complexity comprises a second type of operation, the method comprises:
before each image block in an image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining third coding parameters for the image block by using the second type of operation;
and encoding the image block by using the third encoding parameter.
10. The electronic device control method according to claim 5, characterized in that the method comprises:
if the first type of operation and the second type of operation are used to reduce the complexity of the encoding operation, detecting whether the operating parameters of the electronic device meet the preset conditions before encoding each image frame;
if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fourth encoding parameters for the image frame by using the first type of operation;
before each image block in the image frame is coded, if the operation parameters of the electronic equipment are detected to meet the preset conditions, determining fifth coding parameters for the image block by using the second type of operation;
and encoding the image block by using the fourth encoding parameter and the fifth encoding parameter.
11. An electronic device control apparatus, comprising:
the acquisition module is used for acquiring the operating parameters of the electronic equipment;
the processing module is configured to reduce complexity of the encoding operation performed by the electronic device if the operation parameter meets a preset condition, where the operation parameter meets the preset condition and indicates that the electronic device is in at least one of the following states: a state requiring a limitation of power consumption, a state requiring a limitation of heat generation, and a state requiring a centralized allocation of system resources to at least one application.
12. A computer-readable storage medium, on which a computer program is stored, which, when executed on a computer, causes the computer to carry out the method according to any one of claims 1 to 10.
13. An electronic device comprising a memory, a processor, wherein the processor is configured to perform the method of any one of claims 1 to 10 by invoking a computer program stored in the memory.
CN202110357593.7A 2021-04-01 2021-04-01 Electronic device control method, electronic device control device, storage medium and electronic device Pending CN115185362A (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN202110357593.7A CN115185362A (en) 2021-04-01 2021-04-01 Electronic device control method, electronic device control device, storage medium and electronic device
PCT/CN2022/073903 WO2022206153A1 (en) 2021-04-01 2022-01-26 Electronic device control method and apparatus, and storage medium and electronic device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110357593.7A CN115185362A (en) 2021-04-01 2021-04-01 Electronic device control method, electronic device control device, storage medium and electronic device

Publications (1)

Publication Number Publication Date
CN115185362A true CN115185362A (en) 2022-10-14

Family

ID=83455564

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110357593.7A Pending CN115185362A (en) 2021-04-01 2021-04-01 Electronic device control method, electronic device control device, storage medium and electronic device

Country Status (2)

Country Link
CN (1) CN115185362A (en)
WO (1) WO2022206153A1 (en)

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101719965A (en) * 2009-12-03 2010-06-02 北京中星微电子有限公司 Power saving method and device for mobile terminal
CN104219590A (en) * 2013-06-05 2014-12-17 华为终端有限公司 Method for switching coding modes, transmitting end and receiving end
US20150181208A1 (en) * 2013-12-20 2015-06-25 Qualcomm Incorporated Thermal and power management with video coding
US10402932B2 (en) * 2017-04-17 2019-09-03 Intel Corporation Power-based and target-based graphics quality adjustment
CN110266886B (en) * 2019-06-21 2021-04-16 Oppo广东移动通信有限公司 Battery management method and related product
CN111093076A (en) * 2019-12-25 2020-05-01 西安万像电子科技有限公司 Encoding mode determining method and device

Also Published As

Publication number Publication date
WO2022206153A1 (en) 2022-10-06

Similar Documents

Publication Publication Date Title
EP3085071B1 (en) Thermal and power management
US11611764B2 (en) Method and apparatus of HEVC de-blocking filter
US11470327B2 (en) Scene aware video content encoding
CN111479115B (en) Video image processing method and device and computer readable storage medium
GB2560548A (en) Video data processing system
JP2011066844A (en) Parallel decoding device, program, and parallel decoding method of coded data
KR20200060589A (en) System-on-chip having merged frc and video codec and frame rate converting method thereof
CN114466221A (en) Image processing method and device, storage medium and electronic equipment
CN115185362A (en) Electronic device control method, electronic device control device, storage medium and electronic device
CN105100799A (en) Method for reducing intraframe coding time delay in HEVC encoder
EP4178201A1 (en) Video processing method and apparatus, device, and storage medium
Wang et al. Highly parallel HEVC decoding for heterogeneous systems with CPU and GPU
Senn et al. Joint DVFS and parallelism for energy efficient and low latency software video decoding
JP2009177353A (en) Encoder, method of controlling the same, and computer program
CN115190305A (en) Method, apparatus, medium, and system for image processing in video encoding apparatus
WO2014127961A1 (en) Combined parallel and pipelined video encoder
CN113852816A (en) Video frame processing method and device, computer equipment and readable storage medium
CN115712337A (en) Scheduling method and device of processor, electronic equipment and storage medium
CN116389763B (en) Video coding method and device based on multiple encoders
CN113765886B (en) Multimedia playing method and device, storage medium and electronic equipment
CN113573066B (en) Video coding method and device
Wang et al. Dynamic macroblock wavefront parallelism for parallel video coding
WO2022206166A1 (en) Method and device for performing image processing in a video encoding device, and system
CN102196257A (en) Method and device for prejudging macroblock coding mode
CN115190302A (en) Method, device and system for processing image in video decoding device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination