CN108153506B - Image processing method and device and terminal equipment - Google Patents
Image processing method and device and terminal equipment Download PDFInfo
- Publication number
- CN108153506B CN108153506B CN201810066694.7A CN201810066694A CN108153506B CN 108153506 B CN108153506 B CN 108153506B CN 201810066694 A CN201810066694 A CN 201810066694A CN 108153506 B CN108153506 B CN 108153506B
- Authority
- CN
- China
- Prior art keywords
- resource
- amount
- resources
- image
- maximum
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F3/00—Input arrangements for transferring data to be processed into a form capable of being handled by the computer; Output arrangements for transferring data from processing unit to output unit, e.g. interface arrangements
- G06F3/14—Digital output to display device ; Cooperation and interconnection of the display device with other functional units
- G06F3/1407—General aspects irrespective of display type, e.g. determination of decimal point position, display with fixed or driving decimal point, suppression of non-significant zeros
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F9/00—Arrangements for program control, e.g. control units
- G06F9/06—Arrangements for program control, e.g. control units using stored programs, i.e. using an internal store of processing equipment to receive or retain programs
- G06F9/46—Multiprogramming arrangements
- G06F9/50—Allocation of resources, e.g. of the central processing unit [CPU]
- G06F9/5005—Allocation of resources, e.g. of the central processing unit [CPU] to service a request
- G06F9/5027—Allocation of resources, e.g. of the central processing unit [CPU] to service a request the resource being a machine, e.g. CPUs, Servers, Terminals
Abstract
The disclosure relates to an image processing method, an image processing device and a terminal device, wherein the method comprises the following steps: determining N first resource quantities corresponding to the image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1; and scheduling the N resources according to the N first resource quantities, and displaying the image to be displayed through the N resources. Thereby ensuring the fluency of image display.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processing method and apparatus, and a terminal device.
Background
Currently, most terminal devices have powerful video and image processing capabilities. Where video is composed of images of one frame, the video processing technique is actually an image processing technique.
As user demands continue to increase, more and more terminal devices are required to have processing capability for larger images. The size of a large image is usually over several tens of millions of pixels, which brings great challenges to the performance of devices such as a Central Processing Unit (CPU), a Graphics Processing Unit (GPU), an input/output (I/O) interface, a memory, and a BUS.
Disclosure of Invention
In order to overcome the problems in the related art, the present disclosure provides an image processing method, an image processing apparatus, and a terminal device. The technical scheme is as follows:
according to a first aspect of embodiments of the present disclosure, there is provided an image processing method, including: determining N first resource quantities corresponding to the image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1; and scheduling the N resources according to the N first resource quantities, and displaying the image to be displayed through the N resources.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: according to the method and the device, the terminal equipment meets the requirements of N first resource amounts corresponding to the image to be displayed as far as possible, and the image to be displayed is displayed through the scheduled N resources, so that the fluency of image display can be ensured.
Optionally, scheduling the N resources according to the N first resource amounts includes: determining N second resource quantities, wherein the N second resource quantities are respectively the resource quantities of the N resources which are not distributed; and scheduling the N resources according to the N first resource quantities and the N second resource quantities.
Optionally, scheduling the N resources according to the N second resource amounts and the N first resource amounts includes: for any resource in the N resources, if the second resource amount of the resource is larger than or equal to the first resource amount of the resource, the resource is scheduled; the resource amount of the scheduled resource is a first resource amount of the resource or a second resource amount of the resource; and if the second resource amount of the resources is smaller than the first resource amount of the resources, scheduling the resources according to the maximum resource amount of the resources and the first resource amount of the resources.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the terminal equipment can schedule the N first resources according to the N first resource quantities and the N second resource quantities, and displays the image to be displayed through the scheduled N resources, so that the fluency of image display can be ensured. Furthermore, if the second resource amount of the resource M is greater than or equal to the first resource amount of the resource M, the resource M is directly scheduled, and when the scheduled resource amount is the first resource amount, but not the second resource amount, the waste of the resource M can be reduced.
Optionally, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource, includes: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting the partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; on one hand, the fluency of image display can be ensured, and on the other hand, when the resource quantity of the scheduled resource is the first resource quantity instead of the maximum resource quantity, the waste of the resource can be reduced. Further, if the maximum resource amount of the resource is less than the first resource amount of the resource, the current frame rate is reduced, and the resource is scheduled according to the reduced frame rate. Thereby ensuring the fluency of image display.
Optionally, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource, includes: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resource is less than the first resource amount of the resource, reducing the current frame rate, and scheduling the resource according to the reduced frame rate; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; on one hand, the fluency of image display can be ensured, and on the other hand, when the resource quantity of the scheduled resource is the first resource quantity instead of the maximum resource quantity, the waste of the resource can be reduced. Further, if the maximum resource amount of the resource is less than the first resource amount of the resource, deleting the partial data corresponding to the image to be displayed, and scheduling the resource according to the deleted partial data. Thereby ensuring the fluency of image display.
Optionally, the N resources comprise at least one of: CPU, GPU, I/O interface, memorizer and BUS BUS.
The following describes an embodiment of the present invention to provide an image processing apparatus, wherein the apparatus portion corresponds to the above method, and the corresponding content and technical effects are the same, which are not described herein again.
According to a first aspect of embodiments of the present disclosure, there is provided an image processing apparatus including: the device comprises a determining module, a scheduling module and a display module.
The determining module is configured to determine N first resource quantities corresponding to the image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1; the scheduling module is configured to schedule the N resources according to the N first resource amounts: the display module is configured to display an image to be displayed through the N resources.
Optionally, the scheduling module includes: a determination submodule and a scheduling submodule. The determining submodule is configured to determine N second resource quantities, which are resource quantities to which the N resources are not allocated respectively; the scheduling sub-module is configured to schedule the N resources according to the N first resource amounts and the N second resource amounts.
Optionally, the scheduling sub-module is configured to: for any resource in the N resources, if the second resource amount of the resource is larger than or equal to the first resource amount of the resource, the resource is scheduled; the resource amount of the scheduled resource is a first resource amount of the resource or a second resource amount of the resource; and if the second resource amount of the resources is smaller than the first resource amount of the resources, scheduling the resources according to the maximum resource amount of the resources and the first resource amount of the resources.
Optionally, the scheduling sub-module is configured to: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting the partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
Optionally, the scheduling sub-module is configured to: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resource is less than the first resource amount of the resource, reducing the current frame rate, and scheduling the resource according to the reduced frame rate; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
Optionally, the N resources comprise at least one of: CPU, GPU, I/O interface, memorizer and BUS BUS.
According to a third aspect of the embodiments of the present disclosure, there is provided a terminal device, including: a processor and a display; a memory for storing executable instructions of the processor; the processor is configured to determine N first resource quantities corresponding to the image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1; scheduling N resources according to the N first resource quantities; the display is configured to display an image to be displayed through the N resources.
The technical scheme provided by the embodiment of the disclosure can have the following beneficial effects: the present disclosure provides an image processing method, an image processing device and a terminal device, wherein the method comprises the following steps: determining N first resource quantities corresponding to the image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1; and scheduling the N resources according to the N first resource quantities, and displaying the image to be displayed through the N resources. According to the method and the device, the terminal equipment meets the requirements of N first resource amounts corresponding to the image to be displayed as far as possible, and the image to be displayed is displayed through the scheduled N resources, so that the fluency of image display can be ensured.
It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the disclosure.
Drawings
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and together with the description, serve to explain the principles of the disclosure.
FIG. 1 is a diagram illustrating an application scenario in accordance with an exemplary embodiment;
FIG. 2 is a flow diagram illustrating a method of image processing according to an exemplary embodiment;
FIG. 3 is a flow diagram illustrating a method of image processing according to an exemplary embodiment;
FIG. 4 is a flow diagram illustrating an image processing method according to an exemplary embodiment;
FIG. 5 is a flow diagram illustrating an image processing method according to an exemplary embodiment;
FIG. 6 is a flow diagram illustrating an image processing method according to an exemplary embodiment;
fig. 7 is a block diagram illustrating an image processing apparatus 70 according to another exemplary embodiment;
fig. 8 is a block diagram illustrating an image processing apparatus 70 according to another exemplary embodiment;
fig. 9 is a block diagram illustrating a terminal device 900 according to an example embodiment.
With the foregoing drawings in mind, certain embodiments of the disclosure have been shown and described in more detail below. These drawings and written description are not intended to limit the scope of the disclosed concepts in any way, but rather to illustrate the concepts of the disclosure to those skilled in the art by reference to specific embodiments.
Detailed Description
Reference will now be made in detail to the exemplary embodiments, examples of which are illustrated in the accompanying drawings. When the following description refers to the accompanying drawings, like numbers in different drawings represent the same or similar elements unless otherwise indicated. The implementations described in the exemplary embodiments below are not intended to represent all implementations consistent with the present disclosure. Rather, they are merely examples of apparatus and methods consistent with certain aspects of the present disclosure, as detailed in the appended claims.
The disclosure provides an image processing method and device and terminal equipment. The present disclosure may be applied to several scenarios, (1) fig. 1 is an application scenario schematic diagram shown according to an exemplary embodiment, as shown in fig. 1, a terminal device 11 obtains an image to be displayed from another terminal device, such as a server 12, and the terminal device 11 processes the image to be displayed by using an image processing method provided by the present disclosure to display the image to be displayed. (2) The terminal equipment generates an image to be displayed, and the terminal equipment processes the image to be displayed through the image processing method provided by the disclosure so as to display the image to be displayed.
Wherein, waiting to show the image includes: coordinate information of a plurality of pixel points, pixel values of the plurality of pixel points, and the like.
Fig. 2 is a flowchart illustrating an image processing method according to an exemplary embodiment, which is exemplified by applying the image processing method to a terminal device. The terminal device may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, etc. The image processing method can comprise the following steps:
in step S1: determining N first resource quantities corresponding to an image to be displayed;
optionally, before step S1, the method further includes: a time to detect the N first resource amounts is determined. For example: when the image to be displayed is obtained by the terminal device from another device, the terminal device may determine that the time of the N first resource amounts is a previous frame of the image to be displayed, or the terminal device may determine that the time of the N first resource amounts is a current frame of the image to be displayed. The present disclosure does not limit how the time to detect the N first resource amounts is determined.
The N first resource quantities corresponding to the image to be displayed are determined according to the data corresponding to the image to be displayed; the data corresponding to the image to be displayed is at least one of the following data: 1. and the coordinate information of all the pixel points and the pixel values of all the pixel points included in the image to be displayed. 2. When the image to be displayed is obtained from other terminal equipment, the data corresponding to the image to be displayed further comprises: and the coding information corresponding to the image to be displayed comprises indication information used for indicating which prediction method is adopted and indication information used for indicating which transformation quantization method is adopted. The prediction method is used for eliminating the spatial redundancy, the temporal redundancy, the visual redundancy or the information entropy redundancy and the like of the image, and the transformation quantization method is applied to the image coding process to realize the compression of the image. The prediction method and the transform quantization method described in the present disclosure are prior art, and the present disclosure will not be described herein again.
The N first resource quantities are respectively resource quantities required by N resources of an image to be displayed, and N is a positive integer greater than or equal to 1.
Optionally, the N resources comprise at least one of: CPU, GPU, I/O interface, memory and BUS BUS.
Specifically, when the image to be displayed is obtained by the terminal device from another device, the N resources include: CPU, GPU, I/O interface, memory and BUS BUS. The CPU is mainly used for decoding the image to be displayed, the GPU is mainly used for drawing the image to be displayed, and the I/O interface is mainly used for data transmission between the terminal equipment and other equipment. The memory is mainly used for storing the data corresponding to the image to be displayed. The BUS is used for data transmission among the CPU, the GPU and the memory. When the image to be displayed is generated by the terminal device, the N resources include: GPU, I/O interface, memory, and BUS BUS. The functions of the GPU, the I/O interface, the memory, and the BUS are the same as those of the above-described respective functions, and are not described herein again.
For example: the first amount of resources required by the terminal device for the memory may be 128 Megabytes (MB). The first amount of resources required by the terminal device for the BUS is 20 Hertz (Hz).
In step S2: scheduling N resources according to the N first resource quantities;
in step S3: and displaying the image to be displayed through the N resources.
The description is made in conjunction with step S2 and step S3: and the terminal equipment schedules N resources according to N first resource quantities required by the image to be displayed. Assume that resource X is any one of N resources. The resource X may be partially allocated and partially unallocated. Alternatively, the resources X may be all allocated, or the resources X may be all unallocated. Therefore, the terminal device needs to schedule the resource X according to the condition that the resource X is allocated and the first resource amount corresponding to the resource X.
The following exemplifies steps S2 and S3:
for example: the first amount of resources required for the image-to-memory to be displayed is 128 MB. The current memory allocation case is: the memory only has 60MB of available space, and based on this, the terminal device can meet the first resource amount needed by the memory for the image to be displayed by dynamically adjusting at least one of the available space of the memory, the size of the data corresponding to the image to be displayed and the frame rate.
For example: the first amount of resources required for the image-to-memory to be displayed is 128 MB. The current memory allocation case is: the memory is left with only 900MB of available space, on the basis of which the terminal device can directly schedule the available memory resources to meet the first amount of resources required for the memory of the image to be displayed.
For example: the first amount of resources required for the image pair bus to be displayed is 40 Hz. The current bus allocation case is: and based on the fact that the only remaining available bandwidth of the bus is 20Hz, the terminal equipment meets the first resource quantity required by the bus of the image to be displayed by dynamically adjusting at least one of the available bandwidth of the bus, the size of the corresponding data of the image to be displayed and the frame rate.
For example: the first amount of resources required for the image pair bus to be displayed is 40 Hz. The current bus allocation case is: the only remaining available bandwidth of the bus is 80Hz, based on which the terminal device can directly schedule the available bandwidth to meet the first amount of resources required for the bus for the image to be displayed.
In summary, the present disclosure provides an image processing method, including: determining N first resource quantities corresponding to an image to be displayed; and scheduling the N resources according to the N first resource quantities, and displaying the image to be displayed through the N resources. That is, in the present disclosure, the terminal device meets the requirement of the N first resource amounts corresponding to the image to be displayed as much as possible, and displays the image to be displayed through the scheduled N resources, thereby ensuring the fluency of image display.
On the basis of the corresponding embodiment of fig. 2, step S2 is explained as follows:
the first alternative is as follows: when any resource in the N resources is sufficient, for example, the resource amount of the resource is far greater than the first resource amount required for the resource of the image to be displayed, the resource may be directly scheduled according to the first resource amount of the resource.
The second option is: fig. 3 is a flowchart illustrating an image processing method according to an exemplary embodiment, wherein the above step S2 includes the steps of:
in step S21: determining N second resource quantities, wherein the N second resource quantities are respectively the resource quantities of the N resources which are not distributed;
in step S22: and scheduling the N resources according to the N first resource quantities and the N second resource quantities.
For example: when the second resource amount of the resource M is greater than or equal to the first resource amount of the resource M, it indicates that the unallocated portion of the resource M can meet the requirement of the terminal device, and based on this, the resource M can be directly scheduled.
The first method is as follows: the terminal device schedules the portion of resource M that has been allocated.
The second method comprises the following steps: the terminal device adjusts the image frame rate.
The third method comprises the following steps: and deleting the partial data corresponding to the image to be displayed by the terminal equipment.
The following description is made with respect to step S22:
the first alternative is as follows: for any resource in the N resources, if the second resource amount of the resource is larger than or equal to the first resource amount of the resource, the resource is scheduled; the resource amount of the scheduled resource is a first resource amount of the resource or a second resource amount of the resource. If the second resource amount of the resource is smaller than the first resource amount of the resource, the current frame rate is reduced. And scheduling resources according to the reduced frame rate; or if the second resource amount of the resource is smaller than the first resource amount of the resource, deleting the partial data corresponding to the image to be displayed, and scheduling the resource according to the deleted partial data.
The second option is: fig. 4 is a flowchart illustrating an image processing method according to an exemplary embodiment, wherein the above step S22 includes the steps of:
in step S221: for any resource in the N resources, if the second resource amount of the resource is larger than or equal to the first resource amount of the resource, the resource is scheduled; the resource amount of the scheduled resource is a first resource amount of the resource or a second resource amount of the resource.
In step S222: and if the second resource amount of the resource is smaller than the first resource amount of the resource, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource.
Wherein the maximum resource amount of the resources comprises: the amount of allocated resources and the amount of unallocated resources of the resource.
Specifically, as described above, if the second resource amount of the resource M is greater than or equal to the first resource amount of the resource M, the resource M is directly scheduled, and when the resource amount of the scheduled resource is the first resource amount, instead of the second resource amount, the fluency of the image to be displayed is ensured, and meanwhile, the waste of the resource M can be reduced. And if the second resource amount of the resource M is smaller than the first resource amount of the resource M, scheduling the resource according to the maximum resource amount of the resource M and the first resource amount of the resource M.
In the disclosure, the terminal device may schedule the N first resources according to the N first resource amounts and the N second resource amounts, and display the image to be displayed through the scheduled N resources, so that smoothness of image display may be ensured. Furthermore, if the second resource amount of the resource M is greater than or equal to the first resource amount of the resource M, the resource M is directly scheduled, and when the scheduled resource amount is the first resource amount, but not the second resource amount, the waste of the resource M can be reduced.
Further, the step S222 of scheduling resources according to the maximum resource amount of the resource M and the first resource amount of the resource M includes the following two optional manners:
alternatively, fig. 5 is a flowchart illustrating an image processing method according to an exemplary embodiment, wherein the step S222 includes the steps of:
in step S2221: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource;
in step S2222: if the maximum resource amount of the resource is less than the first resource amount of the resource, reducing the current frame rate, and scheduling the resource according to the reduced frame rate; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
For example: if the maximum resource amount of the resource is smaller than the first resource amount of the resource, the current frame rate is reduced from 16 frames per second to 8 frames per second, that is, the number of frames per second is reduced. Based on this, assuming that the frame rate is 16 frames per second, the bandwidth required by the image to be displayed is 40Hz, and when the frame rate is reduced to 8 frames per second, the bandwidth required by the image to be displayed is 20 Hz. Namely, the first resource amount corresponding to the bus is updated to 20Hz, and further, the terminal device may schedule the bus according to the updated first resource amount.
In the present disclosure, a resource is scheduled if the maximum amount of resources is greater than or equal to a first amount of resources of the resource; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; on one hand, the fluency of image display can be ensured, and on the other hand, when the resource quantity of the scheduled resource is the first resource quantity instead of the maximum resource quantity, the waste of the resource can be reduced. Further, if the maximum resource amount of the resource is less than the first resource amount of the resource, the current frame rate is reduced, and the resource is scheduled according to the reduced frame rate. Thereby ensuring the fluency of image display.
Alternatively, fig. 6 is a flowchart illustrating an image processing method according to an exemplary embodiment, wherein the step S222 includes the steps of:
in step S2223: if the maximum resource amount of the resources is larger than or equal to the first resource amount of the resources, scheduling the resources; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource;
in step S2224: if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting the partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the resource amount of the scheduled resource is less than or equal to the maximum resource amount of the resource.
For example: if the maximum resource amount of the resource is less than the first resource amount of the resource, a processing mode can be adopted for the image to be displayed. The downsampling process may be understood as deleting pixel points in the image to be displayed, and the coordinates and pixel values corresponding to the pixel points. Assuming that the resolution of the current image to be displayed is 640 × 480, the resolution is 320 × 240 after the down-sampling processing is performed on the current image to be displayed. Based on this, if the resolution of the image to be displayed is 640 × 480, the bandwidth required by the image to be displayed is 40Hz, and if the resolution of the image to be displayed is 320 × 240, the bandwidth required by the image to be displayed is 20 Hz. Namely, the first resource amount corresponding to the bus is updated to 20Hz, and further, the terminal device may schedule the bus according to the updated first resource amount.
In the present disclosure, a resource is scheduled if the maximum amount of resources is greater than or equal to a first amount of resources of the resource; the resource amount of the scheduled resource is a first resource amount of the resource or a maximum resource amount of the resource; on one hand, the fluency of image display can be ensured, and on the other hand, when the resource quantity of the scheduled resource is the first resource quantity instead of the maximum resource quantity, the waste of the resource can be reduced. Further, if the maximum resource amount of the resource is less than the first resource amount of the resource, deleting the partial data corresponding to the image to be displayed, and scheduling the resource according to the deleted partial data. Thereby ensuring the fluency of image display.
Fig. 7 is a block diagram illustrating an image processing apparatus 70 according to another exemplary embodiment; the image processing apparatus may be implemented as part or all of a terminal device by software, hardware, or a combination of both. As shown in fig. 7, the apparatus 70 includes:
a determining module 71, configured to determine N first resource amounts corresponding to an image to be displayed, where the N first resource amounts are resource amounts required by N resources of the image to be displayed, respectively, and N is a positive integer greater than or equal to 1;
a scheduling module 72 configured to schedule the N resources according to the N first resource amounts:
a display module 73 configured to display the image to be displayed through the N resources.
Further, fig. 8 is a block diagram illustrating an image processing apparatus 70 according to another exemplary embodiment; as shown in fig. 8, the scheduling module 72 includes: a determining submodule 721 configured to determine N second resource amounts, which are the resource amounts to which the N resources are not allocated, respectively;
a scheduling submodule 722 configured to schedule the N resources according to the N first resource amounts and the N second resource amounts.
Optionally, the scheduling submodule 722 is configured to: for any resource in the N resources, if the second resource amount of the resource is greater than or equal to the first resource amount of the resource, scheduling the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a second resource amount of the resource; and if the second resource amount of the resource is smaller than the first resource amount of the resource, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource.
Optionally, the scheduling submodule 722 is configured to: scheduling the resource if the maximum resource amount of the resource is greater than or equal to a first resource amount of the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources.
Optionally, the scheduling submodule 722 is configured to: scheduling the resource if the maximum resource amount of the resource is greater than or equal to a first resource amount of the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a maximum resource amount of the resource; if the maximum resource amount of the resources is less than the first resource amount of the resources, reducing the current frame rate, and scheduling the resources according to the reduced frame rate; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources.
Optionally, the N resources comprise at least one of: CPU, GPU, I/O interface, memorizer and BUS BUS.
With regard to the apparatus in the above-described embodiment, the specific manner in which each module performs the operation has been described in detail in the embodiment related to the method, and will not be elaborated here.
Fig. 9 is a block diagram illustrating a terminal device 900 according to an example embodiment. For example, the terminal device 900 may be a mobile phone, a computer, a digital broadcast terminal, a messaging device, a game console, a tablet device, a medical device, a fitness device, a personal digital assistant, and the like.
Referring to fig. 9, terminal device 900 may include one or more of the following components: processing component 902, memory 904, power component 906, multimedia component 908, audio component 910, input/output (I/O) interface 912, sensor component 914, and communication component 916.
The processing component 902 generally controls overall operation of the terminal device 900, such as operations associated with display, telephone calls, data communications, camera operations, and recording operations. Processing component 902 may include one or more processors 920 to execute instructions to perform all or a portion of the steps of the methods described above. Further, processing component 902 can include one or more modules that facilitate interaction between processing component 902 and other components. For example, the processing component 902 can include a multimedia module to facilitate interaction between the multimedia component 908 and the processing component 902.
The power component 906 provides power to the various components of the terminal device 900. The power components 906 may include a power management system, one or more power sources, and other components associated with generating, managing, and distributing power for the terminal device 900.
The multimedia component 908 comprises a touch sensitive display screen providing an output interface between the terminal device 900 and a user. In some embodiments, the touch display screen may include a Liquid Crystal Display (LCD) and a Touch Panel (TP). The touch panel includes one or more touch sensors to sense touch, slide, and gestures on the touch panel. The touch sensor may not only sense the boundary of a touch or slide action, but also detect the duration and pressure associated with the touch or slide operation. In some embodiments, the multimedia component 908 includes a front facing camera and/or a rear facing camera. The front camera and/or the rear camera may receive external multimedia data when the terminal device 900 is in an operation mode, such as a shooting mode or a video mode. Each front camera and rear camera may be a fixed optical lens system or have a focal length and optical zoom capability.
The audio component 910 is configured to output and/or input audio signals. For example, the audio component 910 includes a Microphone (MIC) configured to receive external audio signals when the terminal apparatus 900 is in an operating mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signals may further be stored in the memory 904 or transmitted via the communication component 916. In some embodiments, audio component 910 also includes a speaker for outputting audio signals.
I/O interface 912 provides an interface between processing component 902 and peripheral interface modules, which may be keyboards, click wheels, buttons, etc. These buttons may include, but are not limited to: a main bar button, a volume button, a start button, and a lock button.
The sensor component 914 includes one or more sensors for providing status evaluation of various aspects for the terminal device 900. For example, sensor assembly 914 can detect an open/closed state of terminal device 900, the relative positioning of components, such as a display and keypad of terminal device 900, sensor assembly 914 can also detect a change in the position of terminal device 900 or a component of terminal device 900, the presence or absence of user contact with terminal device 900, orientation or acceleration/deceleration of terminal device 900, and a change in the temperature of terminal device 900. The sensor assembly 914 may include a proximity sensor configured to detect the presence of a nearby object in the absence of any physical contact. The sensor assembly 914 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor assembly 914 may also include an acceleration sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 916 is configured to facilitate communication between the terminal device 900 and other devices in a wired or wireless manner. Terminal device 900 may access a wireless network based on a communication standard, such as WiFi, 2G or 3G, or a combination thereof. In an exemplary embodiment, the communication component 916 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In an exemplary embodiment, the communication component 916 further includes a Near Field Communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on Radio Frequency Identification (RFID) technology, infrared data association (IrDA) technology, Ultra Wideband (UWB) technology, Bluetooth (BT) technology, and other technologies.
In an exemplary embodiment, the terminal device 900 may be implemented by one or more Application Specific Integrated Circuits (ASICs), Digital Signal Processors (DSPs), Digital Signal Processing Devices (DSPDs), Programmable Logic Devices (PLDs), Field Programmable Gate Arrays (FPGAs), controllers, micro-controllers, microprocessors or other electronic components for performing the above-described image processing methods.
In an exemplary embodiment, a non-transitory computer readable storage medium comprising instructions, such as memory 904 comprising instructions, executable by processor 920 of terminal device 900 to perform the above-described method is also provided. For example, the non-transitory computer readable storage medium may be a ROM, a Random Access Memory (RAM), a CD-ROM, a magnetic tape, a floppy disk, an optical data storage device, and the like.
A non-transitory computer readable storage medium, in which instructions that, when executed by a processor of a terminal device 900, enable the terminal device 900 to perform some of the steps of the above-described image processing method.
Other embodiments of the disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the disclosure disclosed herein. This disclosure is intended to cover any variations, uses, or adaptations of the disclosure following, in general, the principles of the disclosure and including such departures from the present disclosure as come within known or customary practice within the art to which the disclosure pertains. It is intended that the specification and examples be considered as exemplary only, with a true scope and spirit of the disclosure being indicated by the following claims.
It will be understood that the present disclosure is not limited to the precise arrangements described above and shown in the drawings and that various modifications and changes may be made without departing from the scope thereof. The scope of the present disclosure is limited only by the appended claims.
Claims (5)
1. An image processing method, comprising:
determining N first resource quantities corresponding to an image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1;
determining N second resource quantities, wherein the N second resource quantities are respectively the resource quantities of the N resources which are not distributed;
for any resource in the N resources, if the second resource amount of the resource is greater than or equal to the first resource amount of the resource, scheduling the resource, wherein the scheduled resource amount of the resource is the first resource amount of the resource;
if the second resource amount of the resource is smaller than the first resource amount of the resource, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource;
displaying the image to be displayed through the N resources;
the scheduling the resource according to the maximum amount of the resource and the first amount of the resource includes:
scheduling the resource if the maximum resource amount of the resource is greater than or equal to a first resource amount of the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a maximum resource amount of the resource;
if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources;
or if the maximum resource amount of the resources is less than the first resource amount of the resources, reducing the current frame rate, and scheduling the resources according to the reduced frame rate; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources.
2. The method of claim 1, wherein the N resources comprise at least one of: CPU, GPU, I/O interface, memorizer and BUS BUS.
3. An image processing apparatus characterized by comprising:
the image display device comprises a determining module, a display module and a display module, wherein the determining module is configured to determine N first resource quantities corresponding to an image to be displayed, the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1;
determining N second resource quantities, wherein the N second resource quantities are respectively the resource quantities of the N resources which are not distributed; a scheduling module configured to, for any one of the N resources, schedule the resource if a second amount of the resource is greater than or equal to a first amount of the resource, where the scheduled amount of the resource is the first amount of the resource;
if the second resource amount of the resource is smaller than the first resource amount of the resource, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource;
a display module configured to display the image to be displayed through the N resources;
a scheduling sub-module configured to schedule the resource if the maximum amount of the resource is greater than or equal to a first amount of the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a maximum resource amount of the resource;
if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources;
or if the maximum resource amount of the resources is less than the first resource amount of the resources, reducing the current frame rate, and scheduling the resources according to the reduced frame rate; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources.
4. The apparatus of claim 3, wherein the N resources comprise at least one of: CPU, GPU, I/O interface, memorizer and BUS BUS.
5. A terminal device, comprising:
a processor and a display;
a memory for storing executable instructions of the processor;
wherein the processor is configured to:
determining N first resource quantities corresponding to an image to be displayed, wherein the N first resource quantities are respectively resource quantities required by N resources of the image to be displayed, and N is a positive integer greater than or equal to 1;
determining N second resource quantities, wherein the N second resource quantities are respectively the resource quantities of the N resources which are not distributed;
for any resource in the N resources, if the second resource amount of the resource is greater than or equal to the first resource amount of the resource, scheduling the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource;
if the second resource amount of the resource is smaller than the first resource amount of the resource, scheduling the resource according to the maximum resource amount of the resource and the first resource amount of the resource;
the scheduling the resource according to the maximum amount of the resource and the first amount of the resource includes:
scheduling the resource if the maximum resource amount of the resource is greater than or equal to a first resource amount of the resource; wherein the scheduled resource amount of the resource is a first resource amount of the resource or a maximum resource amount of the resource;
if the maximum resource amount of the resources is less than the first resource amount of the resources, deleting partial data corresponding to the image to be displayed, and scheduling the resources according to the deleted partial data; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources;
or if the maximum resource amount of the resources is less than the first resource amount of the resources, reducing the current frame rate, and scheduling the resources according to the reduced frame rate; wherein the amount of the scheduled resources is less than or equal to the maximum amount of the resources;
the display is configured to display the image to be displayed through the N resources.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810066694.7A CN108153506B (en) | 2018-01-24 | 2018-01-24 | Image processing method and device and terminal equipment |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201810066694.7A CN108153506B (en) | 2018-01-24 | 2018-01-24 | Image processing method and device and terminal equipment |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN108153506A CN108153506A (en) | 2018-06-12 |
| CN108153506B true CN108153506B (en) | 2021-07-13 |
Family
ID=62458964
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201810066694.7A Active CN108153506B (en) | 2018-01-24 | 2018-01-24 | Image processing method and device and terminal equipment |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN108153506B (en) |
Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101794567A (en) * | 2010-02-10 | 2010-08-04 | 中兴通讯股份有限公司 | Method and terminal for loading pictures |
| CN103929608A (en) * | 2014-04-16 | 2014-07-16 | 浙江宇视科技有限公司 | Buffer memory capacity dynamic allocation method and device |
| CN104572298A (en) * | 2014-12-31 | 2015-04-29 | 四达时代通讯网络技术有限公司 | Video cloud platform resource dispatching method and device |
Family Cites Families (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3000232A4 (en) * | 2013-05-23 | 2017-01-25 | Kabushiki Kaisha Square Enix Holdings (also trading as Square Enix Holdings Co., Ltd) | Dynamic allocation of rendering resources in a cloud gaming system |
-
2018
- 2018-01-24 CN CN201810066694.7A patent/CN108153506B/en active Active
Patent Citations (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN101794567A (en) * | 2010-02-10 | 2010-08-04 | 中兴通讯股份有限公司 | Method and terminal for loading pictures |
| CN103929608A (en) * | 2014-04-16 | 2014-07-16 | 浙江宇视科技有限公司 | Buffer memory capacity dynamic allocation method and device |
| CN104572298A (en) * | 2014-12-31 | 2015-04-29 | 四达时代通讯网络技术有限公司 | Video cloud platform resource dispatching method and device |
Also Published As
| Publication number | Publication date |
|---|---|
| CN108153506A (en) | 2018-06-12 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9928811B2 (en) | Methods, devices, and computer-readable storage medium for image display | |
| CN106506448B (en) | Live broadcast display method and device and terminal | |
| US10269287B2 (en) | Power saving method and device for displaying content in display screen | |
| CN107040591B (en) | Method and device for controlling client | |
| US20170116908A1 (en) | Display method and device | |
| CN115719586A (en) | Screen refresh rate adjusting method and device, electronic equipment and storage medium | |
| EP3425533A1 (en) | Displaying page | |
| CN112331158B (en) | Terminal display adjusting method, device, equipment and storage medium | |
| EP3813058A1 (en) | Screen display device, method and device for controlling screen display and storage medium | |
| CN111246278B (en) | Video playing method and device, electronic equipment and storage medium | |
| CN108153506B (en) | Image processing method and device and terminal equipment | |
| CN112866612B (en) | Frame insertion method, device, terminal and computer readable storage medium | |
| CN109981729B (en) | File processing method and device, electronic equipment and computer readable storage medium | |
| CN114442792A (en) | Method and device for adjusting operating frequency of processor and storage medium | |
| CN109389547B (en) | Image display method and device | |
| CN111724398A (en) | Image display method and device | |
| CN114078432A (en) | Driving method and device | |
| CN106604088B (en) | Method, device and equipment for processing data in buffer area | |
| CN112102009A (en) | Advertisement display method, device, equipment and storage medium | |
| CN112035246A (en) | Method, device and system for acquiring virtual resources, electronic equipment and storage medium | |
| CN110784721A (en) | Picture data compression method and device, electronic equipment and storage medium | |
| CN110704197A (en) | Method, apparatus and medium for processing memory access overhead | |
| CN110955328B (en) | Control method and device of electronic equipment and storage medium | |
| US20210360189A1 (en) | Video processing method and apparatus, and storage medium | |
| CN111124099A (en) | State control method, device and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |