CN112887608A - Image processing method and device, image processing chip and electronic equipment - Google Patents
Image processing method and device, image processing chip and electronic equipment Download PDFInfo
- Publication number
- CN112887608A CN112887608A CN202110111128.5A CN202110111128A CN112887608A CN 112887608 A CN112887608 A CN 112887608A CN 202110111128 A CN202110111128 A CN 202110111128A CN 112887608 A CN112887608 A CN 112887608A
- Authority
- CN
- China
- Prior art keywords
- format conversion
- task
- image
- target
- image processing
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000012545 processing Methods 0.000 title claims abstract description 81
- 238000003672 processing method Methods 0.000 title claims abstract description 38
- 238000006243 chemical reaction Methods 0.000 claims abstract description 294
- 238000000034 method Methods 0.000 claims description 41
- 230000008569 process Effects 0.000 claims description 27
- 230000011218 segmentation Effects 0.000 claims description 10
- 230000005540 biological transmission Effects 0.000 claims description 8
- 230000006835 compression Effects 0.000 claims description 6
- 238000007906 compression Methods 0.000 claims description 6
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000003786 synthesis reaction Methods 0.000 claims description 2
- 230000006870 function Effects 0.000 abstract description 17
- 238000007726 management method Methods 0.000 description 13
- 238000010586 diagram Methods 0.000 description 8
- 238000004891 communication Methods 0.000 description 5
- 238000012546 transfer Methods 0.000 description 4
- 238000002156 mixing Methods 0.000 description 3
- 230000003068 static effect Effects 0.000 description 3
- 230000009286 beneficial effect Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 230000001360 synchronised effect Effects 0.000 description 2
- 238000013500 data storage Methods 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 230000002708 enhancing effect Effects 0.000 description 1
- 239000008187 granular material Substances 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000002194 synthesizing effect Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
The embodiment of the application provides an image processing method and device, an image processing chip and electronic equipment, and belongs to the technical field of image processing. The image processing method comprises the following steps: acquiring a target image and a format conversion task of the target image; and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task so that the target format conversion module performs format conversion on the target image. Therefore, different format conversion tasks can be executed on the target image to be processed by utilizing the plurality of format conversion modules with different functions, even the target image with multiple dimensions can be efficiently converted, the requirements of users on different image formats are met, the image format conversion directly performed by the control device of the image processing chip is avoided, the resource occupation of the control device during format conversion is reduced, the conversion efficiency is improved, and the operation pressure of the control device is reduced.
Description
Technical Field
The present disclosure relates to the field of image processing technologies, and in particular, to an image processing method, an image processing apparatus, an image processing chip, an electronic device, and a readable storage medium.
Background
As the processing requirements of image data in mobile phones and monitor chips have increased, a plurality of image processing IPs (Intellectual Property) are often integrated in the chips. The multiple IPs perform pipeline processing on the same image data, but the requirements of the respective IPs on the image data format are not completely compatible, and a conventional universal direct Memory access (dma) device is used to perform only single image data conversion, which does not well support multidimensional image data transfer, and thus the efficiency is very low. And the data format conversion performed by the CPU (central processing unit) software occupies a lot of CPU resources, further reducing the image processing efficiency.
Therefore, it is desirable to provide an efficient DMA apparatus for converting image data format.
Disclosure of Invention
The embodiment of the application provides an image processing method and device, an image processing chip and electronic equipment, and can solve the technical problem of low general DMA image data processing efficiency in the related technology.
In order to solve the above problems, the present application is implemented as follows:
in a first aspect, an embodiment of the present application provides an image processing method, including:
acquiring a target image and a format conversion task of the target image;
and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task so that the target format conversion module performs format conversion on the target image.
In a second aspect, an embodiment of the present application provides an image processing apparatus, including:
the format conversion modules are used for carrying out format conversion on the target image;
and the management module is used for acquiring the target image and the format conversion task of the target image and distributing the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.
In a third aspect, an embodiment of the present application provides an image processing chip, which includes a processor, a memory, and a program or instructions stored on the memory and running on the processor, where the program or instructions, when executed by the processor, implement the steps of the image processing method as provided in the first aspect.
In a fourth aspect, an embodiment of the present application provides an electronic device, including:
an image processing chip as provided in the third aspect.
In a fifth aspect, the present application provides a readable storage medium, on which a program or instructions are stored, which when executed by a processor implement the steps of the image processing method as provided in the first aspect.
In a sixth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, where the communication interface is coupled to the processor, and the processor is configured to execute a program or instructions to implement the steps of the image processing method as provided in the first aspect.
In the embodiment of the application, a target image and a format conversion task of the target image are obtained; and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task so that the target format conversion module performs format conversion on the target image. Therefore, different format conversion tasks can be executed on the target image to be processed by utilizing the plurality of format conversion modules with different functions, even the target image with multiple dimensions can be efficiently converted, the requirements of users on different image formats are met, the image format conversion directly performed by the control device of the image processing chip is avoided, the resource occupation of the control device during format conversion is reduced, the conversion efficiency is improved, and the operation pressure of the control device is reduced.
Drawings
FIG. 1 shows one of the flow diagrams of an image processing method according to one embodiment of the present application;
FIG. 2 shows a second flowchart of an image processing method according to an embodiment of the present application;
FIG. 3 shows a third flowchart of an image processing method according to an embodiment of the present application;
FIG. 4 shows a fourth flowchart of an image processing method according to an embodiment of the present application;
FIG. 5 shows a fifth flowchart of an image processing method according to an embodiment of the present application;
FIG. 6 shows a sixth flowchart of an image processing method according to an embodiment of the present application;
FIG. 7 shows one of the block diagrams of the structure of an image processing apparatus according to an embodiment of the present application;
fig. 8 shows a second block diagram of the configuration of an image processing apparatus according to an embodiment of the present application;
fig. 9 shows a third block diagram of the configuration of an image processing apparatus according to an embodiment of the present application;
FIG. 10 shows one of the block diagrams of the structure of an image processing chip according to one embodiment of the present application;
FIG. 11 shows a second block diagram of the architecture of an image processing chip according to an embodiment of the present application;
fig. 12 shows a hardware configuration diagram of an electronic device according to an embodiment of the present application.
Detailed Description
In order that the above objects, features and advantages of the present application can be more clearly understood, the present application will be described in further detail with reference to the accompanying drawings and detailed description. It should be noted that the embodiments and features of the embodiments of the present application may be combined with each other without conflict.
In the following description, numerous specific details are set forth in order to provide a thorough understanding of the present application, however, the present application may be practiced in other ways than those described herein, and therefore the scope of the present application is not limited by the specific embodiments disclosed below.
An image processing method, an apparatus, an image processing chip, and an electronic device according to some embodiments of the present application are described below with reference to fig. 1 to 12.
In an embodiment of the present application, fig. 1 shows one of flowcharts of an image processing method of an embodiment of the present application, including:
102, acquiring a target image and a format conversion task of the target image;
in this embodiment, the format conversion task includes at least one of: dimension format conversion task, bit width format conversion task and representation format conversion task.
Specifically, for example, the dimension format conversion task includes: the task of converting the dimensional format of images of different dimensions, such as transfer copying of data in one-dimensional linear form, transfer copying of two-dimensional image data, and transfer copying of three-dimensional image data, is to convert a three-dimensional image into a two-dimensional image. The representation format conversion task includes the conversion between RGB format, YUV format and other image representation formats, for example, RGB565, RGB888, YUV444, YUV422, YUV420 and other image representation formats. The bit-width format conversion task includes conversion between a plurality of bit-width formats, for example, interconversion of 8-bit (bit), 76-bit, 24-bit, 32-bit, and the like formats. Wherein, 8 bits is 1 b.
It is understood that the target image may be at least one picture, or may be a video, or may be a picture taken from a video.
And 104, distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.
In the present embodiment, a format conversion task configured by a control apparatus (CPU) and a target image that needs to be format-converted are acquired. And distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task, and executing different format conversion tasks on the target image to be processed by utilizing a plurality of format conversion modules with different functions. On one hand, the parallel processing of the format conversion task can be realized, the time required by format conversion is greatly shortened, and different format conversion tasks can be executed by different format conversion modules, so that different requirements of the output target image during image processing can be met, even a multidimensional image can be subjected to efficient format conversion, the multi-dimensional image carrying is facilitated, and the format conversion efficiency is improved. On the other hand, the control device of the image processing chip is prevented from directly converting the image format, the resource occupation of the control device during image format conversion is reduced, the conversion efficiency is improved, and the operation pressure of the control device is reduced.
It should be noted that the image processing method is applicable to an image processing apparatus including a plurality of independent format conversion modules, and each of the plurality of format conversion modules may perform the same or different format conversion tasks.
In an embodiment of the present application, as shown in fig. 2, in step 104, allocating a format conversion task of a target image to a target format conversion module corresponding to the format conversion task includes:
In this embodiment, before the format conversion task is allocated, the use state of each format conversion module is determined, and if a target format conversion module that needs to execute the format conversion task is in an idle state, which indicates that the target format conversion module can currently execute the format conversion task, the format conversion task is allocated to the target format conversion module in the idle state. If the target format conversion module is in a non-idle state, which indicates that the target format conversion module is currently executing the format conversion task, the task allocation is performed after the target format conversion module is idle, or the format conversion is allocated to other idle target format conversion modules capable of executing the task. Therefore, the realization of the parallel format conversion task is facilitated, the repeated execution of the format conversion task by the format conversion module can be avoided, the unnecessary work of the format conversion module is prevented, the dynamic allocation of the format conversion task can be realized, and the utilization efficiency of the format conversion module is greatly improved.
In an embodiment of the present application, as shown in fig. 3, in step 104, allocating a format conversion task of a target image to a target format conversion module corresponding to the format conversion task includes:
in this embodiment, the cache module is configured to cache data required by the format conversion task, so that the format conversion module can read or re-read the cache data, thereby speeding up reading of the format conversion module, saving time and resources for executing the format conversion task, and being beneficial to reducing an operation load of the format conversion module.
And 304, distributing the format conversion task of the target image to the target format conversion module under the condition that the buffer space is greater than or equal to the preset threshold value.
In this embodiment, before the format conversion task is allocated, the size of the buffer space of the buffer module is determined. And if the current cache space can meet the storage space of the cache data required by the format conversion task, starting to distribute the format conversion task to the target format conversion module so as to execute the image format conversion. And if the current cache space is not enough to support the cache data required by the format conversion task, suspending the allocation of the format conversion task until the cache space is recovered to meet the size of the storage space of the cache data required by the format conversion task, and then starting the allocation of the format conversion task. Therefore, the format conversion task is guaranteed to have enough space for caching, the data reading and writing speed in the image format conversion overshoot is improved, the format conversion task can be smoothly executed, the dynamic allocation of the task can be further realized, the format conversion efficiency is improved, and the reliability of the image processing device is ensured.
In one embodiment of the present application, fig. 4 shows a fourth flowchart of format conversion of an embodiment of the present application, including:
wherein, the process information can be understood as the execution progress of the format conversion task, and the process information includes: task completion information, task progress information, and task interruption information.
Specifically, when the duration of the execution progress of the format conversion task reaching a certain progress threshold reaches a preset time, determining that the progress information is task interruption information; when the execution progress of the format conversion tasks reaches 100% and the duration time reaches the preset time, judging that the process information is task completion information, and when the execution progress of the format conversion tasks does not reach 100% and the duration time at a certain progress threshold value does not reach the preset time, judging that the number conversion tasks are being executed, wherein the process information is task progress information.
In step 404, the format conversion task is interrupted and the cache data corresponding to the format conversion task in the cache module is released when the process information is task completion information or task interruption information.
In this embodiment, in the format conversion process, the current progress information of the format conversion task is determined. If the process information is task completion information or task interruption information, that is, the current format conversion task is completed or has an error, the format conversion task being executed is interrupted, and the cache data corresponding to the format conversion task is released, so that enough resources are available to execute the next format conversion task, the resource utilization rate is improved, and the image format conversion efficiency is ensured.
Further, after the process information is obtained, the process information can be reported to a control device (CPU) so that the control device can record the progress of the format conversion task, and a user can conveniently inquire and trace the image processing process.
In an embodiment of the present application, before the step 104 of allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further includes: compressing the target image according to the image parameters of the target image;
in this embodiment, for an image with a large resolution, size, and bit width, a large number of resources are occupied when performing image format conversion, and the processing speed is low. Therefore, before the format conversion task is carried out, the space occupied by the image is reduced through image compression, so that the operating pressure of the format conversion module is relieved.
In an embodiment of the present application, after the step 104 of allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further includes: decompressing the target image in a compressed state; and outputting the decompressed target image.
In this embodiment, the image parameters before image compression are restored by decompression techniques after format conversion. Therefore, the format conversion efficiency can be effectively improved, the real-time requirement of large-resolution image processing is met, and the usability of the image processing device is enhanced.
For example, a run-length codec (run-length codec) algorithm may be used to perform compression, where two adjacent pixels in an image with similar color values are identified by two bytes, where the first byte is a count value used to specify the number of times a pixel is repeated; the second byte is the value of the particular pixel. Thereby enabling compression while ensuring the quality of the target image.
In an embodiment of the present application, fig. 5 shows a fifth flowchart of an image processing method of an embodiment of the present application, including:
In this embodiment, when the user needs to split the target image, the acquisition control device outputs a splitting task of the target image, and performs a splitting process on the image according to the splitting task. The method can meet the requirement of the output quantity of the target images, and can effectively reduce the processing pressure of the format conversion module when the format conversion is respectively carried out on the plurality of image blocks because the size, the memory occupation and the like of the divided image blocks are smaller than those of the original target images, thereby being capable of carrying out the format conversion on the target images with larger resolution, size and bit width, improving the format conversion speed of the target images, meeting the real-time requirement of the large-resolution image processing and enhancing the usability of the image processing device.
Specifically, the control device may configure the division task in accordance with the image parameters of the target image, or may configure the division task in accordance with a division instruction input by the user. For example, in the squared mode of the image, the target image may be equally divided into 9 images according to the image size.
In an embodiment of the present application, fig. 6 shows a sixth flowchart of an image processing method of an embodiment of the present application, including:
and step 604, merging the target images according to the merging tasks of the target images.
In this embodiment, the acquisition control device outputs a merging task of the target image, and merges the images according to the merging task. The merging processing can not only execute the split image block synthesizing task, but also merge a plurality of complete target images, so that different image requirements of users are met.
For example, when a panoramic scene is shot, a plurality of images need to be combined to obtain a panoramic image.
Specifically, an Alpha Blending (Alpha Blending) technique may be used to merge the target images, and source pixels and target pixels are blended according to an Alpha Blending vector, thereby realizing the synthesis of two target images under the condition of ensuring the definition and the conformity.
In one embodiment of the present application, as shown in fig. 7, an image processing apparatus 700 includes: a plurality of format conversion modules 704, wherein the format conversion modules 704 are used for carrying out format conversion on the target image; the management module 702 is configured to obtain the target image and the format conversion task of the target image, and allocate the format conversion task of the target image to a target format conversion module corresponding to the format conversion task.
Wherein the format conversion task includes but is not limited to at least one of the following: dimension format conversion task, bit width format conversion task and representation format conversion task.
In the present embodiment, the image processing apparatus 700 is provided with a plurality of format conversion modules 704, and the plurality of format conversion modules 704 can simultaneously perform the same or different format conversion tasks. When format conversion of an image is required, a target image to be converted is input to the format conversion module 704, and the management module 702 receives a format conversion task configured by a control device (CPU). The management module 702 distributes the different format conversion tasks to the corresponding format conversion modules 704 that are capable of performing the tasks. On one hand, the independent format conversion modules 704 with different functions are used for executing different format conversion tasks, so that parallel processing of the format conversion tasks can be realized, the time required by format conversion is greatly shortened, different format conversion tasks can be executed by the different format conversion modules 704, different requirements of an output target image during image processing can be considered, format conversion of a multi-dimensional image is realized, multi-dimensional image carrying is facilitated, and the format conversion efficiency of the image processing device 700 is improved.
Further, the format conversion module 704 may be configured to be properly set by different instantiations, for example, it may be set to 5 or 8, etc.
In some embodiments, as shown in fig. 8, the plurality of format conversion modules 704 includes at least one of: a representation format module 7042, the representation format module 7042 is configured to perform representation format conversion on the target image; the bit width format module 7044, the bit width format module 7044 is configured to perform bit width format conversion on the target image; the dimension format module 7046, the dimension format module 7046 is configured to perform dimension format conversion on the target image.
In this embodiment, the format conversion module 704 may configure different format modules according to the format conversion requirement, so as to support the operation of converting multiple target image formats and satisfy the different format requirements during image processing.
In some embodiments, the management module 702 is further configured to assign a format conversion task to a target format conversion module in an idle state.
In some embodiments, as shown in fig. 9, the image processing apparatus 700 further includes: the cache module 706 is connected to the plurality of format conversion modules 704, and the cache module 706 is configured to cache data required by the format conversion task.
In this embodiment, the cache module 706 is utilized to cache the cache data required by the format conversion task for the format conversion module 704 to read or re-read, so as to increase the reading speed of the format conversion module 704, save the time and resources for executing the format conversion task, reduce the operation burden of the format conversion module 704, and when the image processing apparatus 700 fails, the cache data can still provide data support normally within a certain time to complete the format conversion task, thereby improving the availability of the image processing apparatus 700.
It should be noted that different format conversion tasks have different real-time requirements, and the required size of the data caching module 706 is also different.
It can be understood that, because each format conversion module 704 needs a certain data buffer area (buffer) in the image format conversion process, a plurality of format conversion modules 704 can share the buffer resources in the buffer module 706, thereby avoiding repeated creation, processing and transmission of buffer data, further saving the time and resources for executing the format conversion task, and ensuring the stability of format conversion.
In some embodiments, the management module 702 is further configured to allocate a format conversion task to the target format conversion module according to the cache space of the cache module 706.
In this embodiment, the size of the buffer space of the buffer module 706 is determined before the format conversion task is allocated. And if the current cache space can meet the storage space of the cache data required by the format conversion task, starting to distribute the format conversion task to the target format conversion module to complete the image format conversion. And if the current cache space is not enough to support the cache data required by the format conversion task, suspending the allocation of the format conversion task until the cache space is recovered to meet the size of the storage space of the cache data required by the format conversion task, and then starting the allocation of the format conversion task. Therefore, the format conversion task is guaranteed to have enough space for caching, the data reading and writing speed in the image format conversion overshoot is improved, the format conversion task can be smoothly executed, the dynamic allocation of the task can be further realized, the utilization efficiency of the format conversion module 704 is improved, and the reliability of the image processing device 700 is guaranteed.
In some embodiments, the management module 702 is further configured to interrupt the format conversion task according to the process information of the format conversion task, and release the cached data corresponding to the format conversion task in the caching module 706.
In some embodiments, the image processing apparatus 700 further comprises: a segmentation module (not shown in the figure) for segmenting the target image according to a segmentation task of the target image.
In some embodiments, the image processing apparatus 700 further comprises: and a combining module (not shown in the figure) for combining the target images according to the combining task of the target images.
In some embodiments, the image processing apparatus 700 further comprises: the compression module (not shown in the figure) is used for compressing the target image according to the image parameters of the target image and decompressing the target image in a compressed state.
In some embodiments, as shown in fig. 9, the image processing apparatus 700 further includes: a transmission module 708, wherein the transmission module 708 is configured to transmit the image to the format conversion modules 704, or transmit the format-converted target image to a target location.
In this embodiment, after the management module 702 allocates the format conversion task to the format conversion module 704, the read back target image is distributed to the format conversion module 704 through the transmission module 708, and the format conversion module 704 also transmits the converted target image to the transmission module 708 to deliver the target image to the target location.
The target position may be an image processor after format conversion, or may be a display device for displaying a target image, which is not limited in this application.
For example, as shown in fig. 9, the data related to the target image is read and written through the network-on-chip data port. The transmission module 708 distributes the data read back from the bus to the multiple paths of format conversion modules 704, and the multiple paths of image data format conversion modules also transmit the processed data to the transmission module 708, and then write the data to a corresponding double data rate synchronous (DDR) memory or an on-chip Static Random Access Memory (SRAM) address through an on-chip network bus interface.
The control device (CPU) configures a format conversion task corresponding to a target image through a configuration port, the format conversion task based on an event is issued to the management module 702, the management module 702 distributes the task to a certain path of image data format conversion module, the module can execute the task, and the task is reported and interrupted to the CPU when the task is completed or has errors. The shared data buffer pool (the buffer module 706) may be common to the multiple image data format conversion modules.
In this embodiment, when each module of the image processing apparatus 700 executes its respective function, the steps of the image processing method in any of the above embodiments are implemented, and therefore, the image processing apparatus 700 also includes all the beneficial effects of the image processing method in any of the above embodiments, which are not described herein again.
Specifically, the image processing apparatus 700 in the embodiment of the present application may be an apparatus, or may be a component, an integrated circuit, or a chip in a terminal. The device can be mobile electronic equipment or non-mobile electronic equipment. By way of example, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palm top computer, a vehicle-mounted electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook or a Personal Digital Assistant (PDA), and the like, and the non-mobile electronic device may be a server, a Network Attached Storage (NAS), a Personal Computer (PC), a Television (TV), a teller machine or a self-service machine, and the like, and the embodiments of the present application are not particularly limited.
The image processing apparatus 700 in the embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an ios operating system, or other possible operating systems, and embodiments of the present application are not limited specifically.
In an embodiment of the present application, as shown in fig. 10, an image processing chip 800 includes a processor 804, a memory 802, and a program or instructions stored on the memory 802 and executable on the processor 804, where the program or instructions, when executed by the processor 804, implement the steps of the image processing method of any of the above embodiments. Therefore, the image processing chip 800 includes all the advantages of the image processing method provided in any of the above embodiments, which are not described herein again.
In one embodiment of the present application, as shown in fig. 11, the image processing chip 800 includes: a control device 806, connected to the processor 804, for determining and generating a format conversion task according to the conversion parameter; the image processor 808, the image processor 808 is connected with the processor 804 and the control device 806, and the image processor 808 is used for carrying out image processing on the target image; the memory 802 is connected to the image processor 808 and the control device 806, and the memory 802 is also used for storing data necessary for the format conversion task and the image processing.
Specifically, when the electronic device receives a first input of the target image by the user, the control device 806 determines a conversion parameter indicated by the first input, generates a format conversion task according to the conversion parameter, and is responsible for scheduling the whole format conversion task through the control device 806 so as to perform format conversion on the input target image through the processor 804 dedicated to image format conversion. Therefore, the control device 806(CPU) is not needed to directly process the image data, and the efficiency of transferring the image data between the internal memory of the electronic equipment and the on-chip storage device is greatly improved.
Wherein the conversion parameter includes but is not limited to at least one of: image parameters of the target image, source position of the target image, target position of the target image, format of the target image, target format of the target image, number of outputs of the target image, resolution of the target image, and the like.
Further, the Memory 802 includes a Static Random-access Memory 8022 (SRAM) or a Double Data Rate Synchronous Dynamic Random-access Memory (DDR SRAM), and a Memory controller 8024. The static/dynamic random access memory stores data when the control device 806 executes or schedules tasks related to different graphics, and the memory controller 8024 reads and writes the memory granules 900 outside the image processing chip 800.
For example, as shown in fig. 11, the image processor 808 includes at least one of: an image Signal Processor 8082 (ISP), a Video Codec (Video Codec), a Neural network Processor 8084(Neural-network Processing Unit, NPU), a Graphics Processor 8086 (GPU), and a Digital Signal Processor 8088 (DSP). Different image processing functions are implemented by the various image processors 808. The plurality of image processors 808 are interconnected by a Network On Chip (NOC) bus 810, on which the control device 806, the processor 804 and the memory 802 are also mounted.
In one embodiment of the present application, there is provided an electronic device including: the image processing chip according to any of the embodiments described above, therefore, the electronic device includes all the advantages of the image processing chip provided in any of the embodiments described above, which are not described herein again.
Fig. 12 is a schematic hardware structure diagram of an electronic device implementing an embodiment of the present application. The electronic device 1200 includes, but is not limited to: radio frequency unit 1202, network module 1204, audio output unit 1206, input unit 1208, sensors 1210, display unit 1212, user input unit 1214, interface unit 1216, memory 1218, processor 1220, and the like.
Those skilled in the art will appreciate that the electronic device 1200 may further comprise a power supply (e.g., a battery) for supplying power to the various components, and the power supply may be logically connected to the processor 1220 via a power management system, so as to manage charging, discharging, and power consumption management functions via the power management system. The electronic device structure shown in fig. 12 does not constitute a limitation of the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or a different arrangement of components. In the embodiment of the present application, the electronic device includes, but is not limited to, a mobile terminal, a tablet computer, a notebook computer, a palm computer, a vehicle-mounted electronic device, a wearable device, a pedometer, and the like.
Wherein, the processor 1220 obtains a target image and a format conversion task of the target image; and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task.
Further, the processor 1220 is also configured to assign a format conversion task to a target format conversion module in an idle state.
Further, the processor 1220 is further configured to read a cache space of the cache module; and under the condition that the cache space is greater than or equal to the preset threshold value, distributing the format conversion task of the target image to the target format conversion module.
Further, the processor 1220 determines process information of the format conversion task; and under the condition that the process information is task completion information or task interruption information, interrupting the format conversion task and releasing cache data corresponding to the format conversion task in the cache module.
Further, the processor 1220 compresses the target image according to the image parameters of the target image; decompressing the target image in a compressed state; and outputting the decompressed target image.
Further, the processor 1220 is also configured to obtain a segmentation task of the target image; and segmenting the target image according to the segmentation task of the target image.
Further, the processor 1220 is further configured to obtain a merging task of the target image; and merging the target images according to the merging task of the target images.
It should be understood that, in the embodiment of the present application, the radio frequency unit 1202 may be used for transceiving information or transceiving signals during a call, and in particular, receiving downlink data of a base station or sending uplink data to the base station. Radio frequency unit 1202 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
The network module 1204 provides wireless broadband internet access to the user, such as helping the user send and receive e-mails, browse web pages, and access streaming media.
The audio output unit 1206 may convert audio data received by the radio frequency unit 1202 or the network module 1204 or stored in the memory 1218 into an audio signal and output as sound. Also, the audio output unit 1206 may provide audio output related to a specific function performed by the electronic apparatus 1200 (e.g., a call signal reception sound, a message reception sound, and the like). The audio output unit 1206 includes a speaker, a buzzer, a receiver, and the like.
The input unit 1208 is used to receive audio or video signals. The input Unit 1208 may include a Graphics Processing Unit (GPU) 5082 and a microphone 5084, and the Graphics processor 5082 processes image data of still pictures or video obtained by an image capturing device (e.g., a camera) in a video capture mode or an image capture mode. The processed image frames may be displayed on the display unit 1212 or stored in the memory 1218 (or other storage medium) or transmitted via the radio frequency unit 1202 or the network module 1204. The microphone 5084 may receive sound and may be capable of processing the sound into audio data, and the processed audio data may be converted into a format output transmittable to a mobile communication base station via the radio frequency unit 1202 in the case of a phone call mode.
The electronic device 1200 also includes at least one sensor 1210, such as a fingerprint sensor, a pressure sensor, an iris sensor, a molecular sensor, a gyroscope, a barometer, a hygrometer, a thermometer, an infrared sensor, a light sensor, a motion sensor, and others.
The display unit 1212 is used to display information input by the user or information provided to the user. The display unit 1212 may include a display panel 5122, and the display panel 5122 may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
The user input unit 1214 may be used to receive input numeric or character information and generate key signal inputs related to user settings and function control of the electronic device. Specifically, the user input unit 1214 includes a touch panel 5142 and other input devices 5144. Touch panel 5142, also referred to as a touch screen, can collect touch operations by a user on or near it. The touch panel 5142 may include two parts of a touch detection device and a touch controller. The touch detection device detects the touch direction of a user, detects a signal brought by touch operation and transmits the signal to the touch controller; the touch controller receives touch information from the touch sensing device, converts the touch information into touch point coordinates, and sends the touch point coordinates to the processor 1220 to receive and execute commands sent by the processor 1220. Other input devices 5144 may include, but are not limited to, a physical keyboard, function keys (e.g., volume control keys, switch keys, etc.), a trackball, a mouse, and a joystick, which are not described in detail herein.
Further, the touch panel 5142 can be overlaid on the display panel 5122, and when the touch panel 5142 detects a touch operation thereon or nearby, the touch panel is transmitted to the processor 1220 to determine the type of touch event, and then the processor 1220 provides a corresponding visual output on the display panel 5122 according to the type of touch event. The touch panel 5142 and the display panel 5122 can be provided as two separate components or can be integrated into one component.
The interface unit 1216 is an interface for connecting an external device to the electronic apparatus 1200. For example, the external device may include a wired or wireless headset port, an external power supply (or battery charger) port, a wired or wireless data port, a memory card port, a port for connecting a device having an identification module, an audio input/output (I/O) port, a video I/O port, an earphone port, and the like. The interface unit 1216 may be used to receive input (e.g., data information, power, etc.) from an external device and transmit the received input to one or more elements within the electronic apparatus 1200 or may be used to transmit data between the electronic apparatus 1200 and the external device.
The processor 1220 performs various functions of the electronic device 1200 and processes data by running or executing applications and/or modules stored within the memory 1218 and by invoking data stored within the memory 1218 to thereby provide an overall monitoring of the electronic device 1200. Processor 1220 may include one or more processing units; processor 1220 may integrate an application processor, which primarily handles operating systems, user interfaces, applications, etc., and a modem processor, which primarily handles wireless communications.
In an embodiment of the present application, a readable storage medium is provided, on which a program or instructions are stored, which when executed by a processor implement the steps of the image processing method as provided in any of the above embodiments.
In this embodiment, the readable storage medium can implement each process of the image processing method provided in the embodiments of the present application, and can achieve the same technical effect, and is not described herein again to avoid repetition.
The processor is the processor in the electronic device in the above embodiment. Readable storage media, including computer-readable storage media, such as Read-Only Memory (ROM), Random Access Memory (RAM), magnetic or optical disks, etc.
The embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to execute a program or an instruction to implement each process of the embodiment of the image processing method, and can achieve the same technical effect, and in order to avoid repetition, the description is omitted here.
It should be understood that the chips mentioned in the embodiments of the present application may also be referred to as system-on-chip, system-on-chip or system-on-chip, etc.
It should be noted that, in this document, the terms "comprises," "comprising," or any other variation thereof, are intended to cover a non-exclusive inclusion, such that a process, method, article, or apparatus that comprises a list of elements does not include only those elements but may include other elements not expressly listed or inherent to such process, method, article, or apparatus. Without further limitation, an element defined by the phrase "comprising an … …" does not exclude the presence of other like elements in a process, method, article, or apparatus that comprises the element. Further, it should be noted that the scope of the methods and apparatus of the embodiments of the present application is not limited to performing the functions in the order illustrated or discussed, but may include performing the functions in a substantially simultaneous manner or in a reverse order based on the functions involved, e.g., the methods described may be performed in an order different than that described, and various steps may be added, omitted, or combined. In addition, features described with reference to certain examples may be combined in other examples.
Through the above description of the embodiments, those skilled in the art will clearly understand that the method of the above embodiments can be implemented by software plus a necessary general hardware platform, and certainly can also be implemented by hardware, but in many cases, the former is a better implementation manner. Based on such understanding, the technical solutions of the present application may be embodied in the form of a software product, which is stored in a storage medium (such as ROM/RAM, magnetic disk, optical disk) and includes instructions for enabling a terminal (such as a mobile phone, a computer, a server, an air conditioner, or a network device) to execute the method according to the embodiments of the present application.
While the present embodiments have been described with reference to the accompanying drawings, it is to be understood that the invention is not limited to the precise embodiments described above, which are meant to be illustrative and not restrictive, and that various changes may be made therein by those skilled in the art without departing from the spirit and scope of the invention as defined by the appended claims.
The above description is only a preferred embodiment of the present application and is not intended to limit the present application, and various modifications and changes may be made by those skilled in the art. Any modification, equivalent replacement, improvement and the like made within the spirit and principle of the present application shall be included in the protection scope of the present application.
Claims (18)
1. An image processing method, comprising:
acquiring a target image and a format conversion task of the target image;
and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.
2. The image processing method according to claim 1, wherein the allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task comprises:
and distributing the format conversion task to the target format conversion module in an idle state.
3. The image processing method according to claim 1, wherein the allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task comprises:
reading a cache space of a cache module;
and under the condition that the cache space is greater than or equal to a preset threshold value, distributing the format conversion task of the target image to the target format conversion module.
4. The image processing method according to claim 3, further comprising:
determining process information of the format conversion task, wherein the process information comprises: task completion information, task progress information, and task interruption information;
and under the condition that the process information is task completion information or task interruption information, interrupting the format conversion task and releasing cache data corresponding to the format conversion task.
5. The image processing method according to any one of claims 1 to 4,
before the step of allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further includes:
compressing the target image according to the image parameters of the target image;
after the allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further includes:
decompressing the target image in a compressed state;
and outputting the decompressed target image.
6. The image processing method according to any one of claims 1 to 4, further comprising:
acquiring a segmentation task of the target image;
and segmenting the target image according to the segmentation task of the target image.
7. The image processing method according to any one of claims 1 to 4, further comprising:
acquiring a merging task of the target image;
and merging the target images according to the merging tasks of the target images.
8. The image processing method according to any one of claims 1 to 4,
the format conversion task includes at least one of: dimension format conversion task, bit width format conversion task and representation format conversion task.
9. An image processing apparatus characterized by comprising:
the format conversion modules are used for carrying out format conversion on the target image;
and the management module is used for acquiring a target image and a format conversion task of the target image and distributing the format conversion task of the target image to a target format conversion module corresponding to the format conversion task.
10. The image processing apparatus of claim 9, wherein the plurality of format conversion modules comprise at least one of:
the representation format module is used for carrying out representation format conversion on the target image;
the bit width format module is used for carrying out bit width format conversion on the target image;
and the dimension format module is used for carrying out dimension format conversion on the target image.
11. The image processing apparatus according to claim 9, further comprising:
and the cache module is used for caching cache data required by the format conversion task.
12. The image processing apparatus according to any one of claims 9 to 11, further comprising:
the segmentation module is used for segmenting the target image according to the segmentation task of the target image; and/or
The synthesis module is used for combining the target images according to the combination tasks of the target images; and/or
And the compression module is used for compressing the target image according to the image parameters of the target image and decompressing the target image in a compressed state.
13. The image processing apparatus according to any one of claims 9 to 11, further comprising:
and the transmission module is used for transmitting the target image to the plurality of format conversion modules or transmitting the target image after format conversion to a target position.
14. An image processing chip comprising a processor, a memory and a program or instructions stored on the memory and executable on the processor, the program or instructions when executed by the processor implementing the steps of the image processing method according to any one of claims 1 to 8.
15. The image processing chip of claim 14, further comprising:
the control device is connected with the processor and used for generating a format conversion task according to the conversion parameters;
the image processor is connected with the processor and the control device and is used for carrying out image processing on the target image;
the memory is connected with the image processor and the control device, and is also used for storing the format conversion task and the data required by the image processing.
16. The image processing chip of claim 15,
the image processor includes at least one of: image signal processor, video codec, neural network processor, graphics processor, digital signal processor.
17. An electronic device, comprising:
the image processing chip of any of claims 14 to 16.
18. A readable storage medium, characterized in that it stores thereon a program or instructions which, when executed by a processor, implement the steps of the image processing method according to any one of claims 1 to 8.
Priority Applications (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110111128.5A CN112887608A (en) | 2021-01-27 | 2021-01-27 | Image processing method and device, image processing chip and electronic equipment |
| PCT/CN2022/072771 WO2022161227A1 (en) | 2021-01-27 | 2022-01-19 | Image processing method and apparatus, and image processing chip and electronic device |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202110111128.5A CN112887608A (en) | 2021-01-27 | 2021-01-27 | Image processing method and device, image processing chip and electronic equipment |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN112887608A true CN112887608A (en) | 2021-06-01 |
Family
ID=76052743
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202110111128.5A Pending CN112887608A (en) | 2021-01-27 | 2021-01-27 | Image processing method and device, image processing chip and electronic equipment |
Country Status (2)
| Country | Link |
|---|---|
| CN (1) | CN112887608A (en) |
| WO (1) | WO2022161227A1 (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN113867817A (en) * | 2021-09-24 | 2021-12-31 | 深圳Tcl新技术有限公司 | Data processing method and device, electronic equipment and storage medium |
| WO2022161227A1 (en) * | 2021-01-27 | 2022-08-04 | 维沃移动通信有限公司 | Image processing method and apparatus, and image processing chip and electronic device |
| WO2023236766A1 (en) * | 2022-06-08 | 2023-12-14 | 中兴通讯股份有限公司 | Color space conversion method, electronic device and storage medium |
Families Citing this family (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN117750025B (en) * | 2024-02-20 | 2024-05-10 | 上海励驰半导体有限公司 | Image data processing method, device, chip, equipment and medium |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104182279A (en) * | 2014-02-26 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Task scheduling method, device and system |
| CN106611432A (en) * | 2015-10-21 | 2017-05-03 | 深圳市腾讯计算机系统有限公司 | Picture format conversion method, device and system |
| CN109005421A (en) * | 2018-08-17 | 2018-12-14 | 青岛海信电器股份有限公司 | Image processing method and device, computer readable storage medium |
| CN109246478A (en) * | 2018-11-20 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of video format conversion apparatus and method |
| CN112165572A (en) * | 2020-09-10 | 2021-01-01 | Oppo（重庆）智能科技有限公司 | Image processing method, device, terminal and storage medium |
Family Cites Families (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US7142251B2 (en) * | 2001-07-31 | 2006-11-28 | Micronas Usa, Inc. | Video input processor in multi-format video compression system |
| US20080158364A1 (en) * | 2004-05-20 | 2008-07-03 | Hiroshi Miyajima | Image Processing Device and Data Processing Method |
| US9882979B2 (en) * | 2015-03-16 | 2018-01-30 | International Business Machines Corporation | Image file transmission |
| CN105430236B (en) * | 2015-12-22 | 2019-03-29 | 北京眼神智能科技有限公司 | The method that image output format is quickly converted |
| CN112887608A (en) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | Image processing method and device, image processing chip and electronic equipment |
-
2021
- 2021-01-27 CN CN202110111128.5A patent/CN112887608A/en active Pending
-
2022
- 2022-01-19 WO PCT/CN2022/072771 patent/WO2022161227A1/en active Application Filing
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104182279A (en) * | 2014-02-26 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | Task scheduling method, device and system |
| CN106611432A (en) * | 2015-10-21 | 2017-05-03 | 深圳市腾讯计算机系统有限公司 | Picture format conversion method, device and system |
| CN109005421A (en) * | 2018-08-17 | 2018-12-14 | 青岛海信电器股份有限公司 | Image processing method and device, computer readable storage medium |
| CN109246478A (en) * | 2018-11-20 | 2019-01-18 | 郑州云海信息技术有限公司 | A kind of video format conversion apparatus and method |
| CN112165572A (en) * | 2020-09-10 | 2021-01-01 | Oppo（重庆）智能科技有限公司 | Image processing method, device, terminal and storage medium |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2022161227A1 (en) * | 2021-01-27 | 2022-08-04 | 维沃移动通信有限公司 | Image processing method and apparatus, and image processing chip and electronic device |
| CN113867817A (en) * | 2021-09-24 | 2021-12-31 | 深圳Tcl新技术有限公司 | Data processing method and device, electronic equipment and storage medium |
| WO2023236766A1 (en) * | 2022-06-08 | 2023-12-14 | 中兴通讯股份有限公司 | Color space conversion method, electronic device and storage medium |
Also Published As
| Publication number | Publication date |
|---|---|
| WO2022161227A1 (en) | 2022-08-04 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20220408096A1 (en) | Adaptive Transfer Function for Video Encoding and Decoding | |
| CN112887608A (en) | Image processing method and device, image processing chip and electronic equipment | |
| US11711623B2 (en) | Video stream processing method, device, terminal device, and computer-readable storage medium | |
| KR100890236B1 (en) | A method for capturing video data by utilizing a camera cell phone as a camera of a computer | |
| JP6242029B2 (en) | Technology for low power image compression and display | |
| US9232177B2 (en) | Video chat data processing | |
| US20230215076A1 (en) | Image frame display method, apparatus, device, storage medium, and program product | |
| CN105700821B (en) | Semiconductor device and compression/decompression method thereof | |
| US9508109B2 (en) | Graphics processing | |
| JP5870145B2 (en) | Color buffer compression | |
| WO2023125657A1 (en) | Image processing method and apparatus, and electronic device | |
| RU2656727C1 (en) | Compression control surfaces supported by virtual memory | |
| US10249269B2 (en) | System on chip devices and operating methods thereof | |
| WO2019196634A1 (en) | Data processing method and apparatus | |
| US9135036B2 (en) | Method and system for reducing communication during video processing utilizing merge buffering | |
| CN111447439B (en) | Image coding method, image coding device and mobile terminal | |
| CN111417007B (en) | Image transmission method, device, terminal and storage medium | |
| JP2003177958A (en) | Specialized memory device | |
| EP2726995B1 (en) | Methods, apparatuses and computer program products for improving network transmission by reducing memory copy overhead by providing direct access to data | |
| US20230247175A1 (en) | Electronic device for processing video and method for operating the same | |
| CN117435532B (en) | Copying method, device and storage medium based on video hardware acceleration interface | |
| CN113110802B (en) | Image block processing method and device, electronic equipment and readable storage medium | |
| EP4343674A1 (en) | Call processing method and related device thereof | |
| CN113328998B (en) | Image data transmission method and electronic equipment | |
| WO2022252842A1 (en) | Media file transmission method and apparatus |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| RJ01 | Rejection of invention patent application after publication | ||
| RJ01 | Rejection of invention patent application after publication |
Application publication date: 20210601 |