WO2022161227A1

WO2022161227A1 - Image processing method and apparatus, and image processing chip and electronic device

Info

Publication number: WO2022161227A1
Application number: PCT/CN2022/072771
Authority: WO
Inventors: 吴增海
Original assignee: 维沃移动通信有限公司
Priority date: 2021-01-27
Filing date: 2022-01-19
Publication date: 2022-08-04
Also published as: CN112887608A

Abstract

The embodiments of the present application belong to the technical field of image processing. Provided are an image processing method and apparatus, and an image processing chip and an electronic device. The image processing method comprises: acquiring a target image and a format conversion task of the target image; and allocating the format conversion task of the target image to a target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.

Description

Image processing method, device, image processing chip and electronic device

CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims the priority of Chinese Patent Application No. 202110111128.5 filed on January 27, 2021, entitled "Image Processing Method, Device, Image Processing Chip and Electronic Equipment", the entire content of which is incorporated herein by reference.

technical field

The present application relates to the technical field of image processing, and in particular, to an image processing method, an image processing apparatus, an image processing chip, an electronic device, and a readable storage medium.

Background technique

As the processing requirements of image data in mobile phones and monitoring chips have increased, multiple image processing IPs (Intellectual Property, intellectual property) are often integrated into the chips. Multiple IPs process the same image data by pipeline, but the requirements of each IP for the image data format are not fully compatible. Using the traditional general-purpose direct memory access DMA (Direct Memory Access) device, only a single image data conversion can be performed. There is no good support for multi-dimensional image data handling, and the efficiency is very low. Moreover, data format conversion through CPU (Central Processing Unit) software takes up a lot of CPU resources, further reducing the efficiency of image processing.

Therefore, there is an urgent need to provide an efficient DMA device for image data format conversion.

SUMMARY OF THE INVENTION

The embodiments of the present application provide an image processing method, apparatus, image processing chip and electronic device, which can solve the technical problem of low efficiency of general DMA image data processing in the related art.

In order to solve the above problems, this application is implemented as follows:

In a first aspect, an embodiment of the present application provides an image processing method, including:

Get the target image and the format conversion task of the target image;

The format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.

In a second aspect, an embodiment of the present application provides an image processing apparatus, including:

Multiple format conversion modules for format conversion of target images;

The management module is used for acquiring the target image and the format conversion task of the target image, and assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.

In a third aspect, an embodiment of the present application provides an image processing chip, including a processor, a memory, and a program or instruction stored on the memory and running on the processor. When the program or instruction is executed by the processor, the An aspect provides steps of an image processing method.

In a fourth aspect, an embodiment of the present application provides an electronic device, including:

The image processing chip provided by the third aspect.

In a fifth aspect, an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the image processing method provided in the first aspect are implemented.

In a sixth aspect, an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run programs or instructions to implement the steps of the image processing method provided in the first aspect.

In a seventh aspect, an embodiment of the present application provides an electronic device configured to execute the steps of the image processing method described in the first aspect.

In an eighth aspect, an embodiment of the present application provides a computer program product, where the computer program product is executed by a processor to implement the steps of the image processing method according to the first aspect.

In the embodiment of the present application, the target image and the format conversion task of the target image are obtained; the format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image. Therefore, multiple format conversion modules with different functions can be used to perform different format conversion tasks for the target image to be processed. Even multi-dimensional target images can be efficiently formatted to meet the needs of users for different image formats. The control device of the processing chip directly performs image format conversion, which reduces the resource occupation of the control device during format conversion, and reduces the operating pressure of the control device while improving the conversion efficiency.

Description of drawings

FIG. 1 shows one of the flowcharts of an image processing method according to an embodiment of the present application;

FIG. 2 shows the second flowchart of an image processing method according to an embodiment of the present application;

FIG. 3 shows the third flowchart of an image processing method according to an embodiment of the present application;

FIG. 4 shows a fourth flowchart of an image processing method according to an embodiment of the present application;

Fig. 5 shows the fifth flowchart of the image processing method according to an embodiment of the present application;

FIG. 6 shows a sixth flowchart of an image processing method according to an embodiment of the present application;

FIG. 7 shows one of the structural block diagrams of an image processing apparatus according to an embodiment of the present application;

FIG. 8 shows the second structural block diagram of an image processing apparatus according to an embodiment of the present application;

FIG. 9 shows the third structural block diagram of an image processing apparatus according to an embodiment of the present application;

10 shows one of the structural block diagrams of an image processing chip according to an embodiment of the present application;

FIG. 11 shows the second structural block diagram of an image processing chip according to an embodiment of the present application;

FIG. 12 shows a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.

Detailed ways

In order to more clearly understand the above objects, features and advantages of the present application, the present application will be further described in detail below with reference to the accompanying drawings and specific embodiments. It should be noted that the embodiments of the present application and the features in the embodiments may be combined with each other in the case of no conflict.

Many specific details are set forth in the following description to facilitate a full understanding of the present application. However, the present application can also be implemented in other ways different from those described herein. Therefore, the protection scope of the present application is not limited by the specific details disclosed below. Example limitations.

The following describes an image processing method, apparatus, image processing chip, and electronic device according to some embodiments of the present application with reference to FIGS. 1 to 12 .

In an embodiment of the present application, FIG. 1 shows one of the flowcharts of an image processing method according to an embodiment of the present application, including step 102 and step 104 .

Step 102, acquiring the target image and the format conversion task of the target image.

In this embodiment, the format conversion task includes at least one of the following: a dimension format conversion task, a bit-width format conversion task, and a representation format conversion task.

For example, the dimensional format conversion tasks include: one-dimensional linear data transfer and copy, two-dimensional image data transfer and copy, three-dimensional image data copy transfer and other tasks to perform dimensional format conversion on images of different dimensions. Convert to a 2D image. The representation format conversion task includes the mutual conversion between RGB format, YUV format and other image representation formats, for example, RGB565, RGB888, YUV444, YUV422, YUV420 and other image representation formats. The bit-width format conversion task includes conversion between multiple bit-width formats, for example, the mutual conversion of 8bit (bit), 76bit, 24bit, 32bit and other formats. Among them, 8bit (bit)=1b (byte).

It can be understood that the target image may be at least one picture, or may be a video, and of course, may also be a picture captured from a video.

Step 104: Allocate the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.

In this embodiment, a format conversion task configured by a control device (CPU) and a target image that needs to be formatted are acquired. The format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, and a plurality of format conversion modules with different functions are used to perform different format conversion tasks on the target image to be processed. On the one hand, the parallel processing of format conversion tasks can be realized, which greatly shortens the time required for format conversion, and because different format conversion modules can perform different format conversion tasks, the output target image can take into account the different needs of image processing. , even multi-dimensional images can perform efficient format conversion, which is conducive to multi-dimensional image handling and improves format conversion efficiency. On the other hand, it is avoided to directly perform image format conversion through the control device of the image processing chip, thereby reducing the resource occupation of the control device when performing the image format conversion, and reducing the operating pressure of the control device while improving the conversion efficiency.

It should be noted that the image processing method is applicable to an image processing apparatus, and the image processing apparatus includes a plurality of independent format conversion modules, and each format conversion module of the plurality of format conversion modules can perform the same or different format conversion tasks.

In an embodiment of the present application, as shown in FIG. 2, step 104, assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, including:

Step 202: Allocate the format conversion task to the target format conversion module in the idle state.

In this embodiment, before assigning a format conversion task, the usage status of each format conversion module is determined. If the target format conversion module that needs to perform the format conversion task is in an idle state, it means that the target format conversion module can currently perform format conversion. task, the format conversion task is allocated to the target format conversion module in the idle state. If the target format conversion module is in a non-idle state, it means that the target format conversion module is currently performing the format conversion task, then wait for the target format conversion module to be idle before assigning the task, or assign the format conversion to other idle machines that can execute the task. Target format conversion module. Therefore, the parallel format conversion task can be realized, and the format conversion module can be prevented from repeatedly performing the format conversion task, and unnecessary work of the format conversion module can be prevented, so that the dynamic allocation of the format conversion task can be realized, and the utilization efficiency of the format conversion module can be greatly improved.

In some embodiments of the present application, as shown in FIG. 3 , step 104 , assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task includes: step 302 and step 304 .

Step 302, read the cache space of the cache module.

In this embodiment, the cache module is used to cache the cached data required by the format conversion task for reading or re-reading by the format conversion module, which speeds up the reading speed of the format conversion module and saves time and resources for performing the format conversion task. , which is beneficial to reduce the operating burden of the format conversion module, and when the image processing device fails, data support can still be provided normally within a certain period of time through the cached data, so as to complete the format conversion task and improve the available energy of the image processing device.

Step 304 , when the buffer space is greater than or equal to the preset threshold, assign the format conversion task of the target image to the target format conversion module.

In this embodiment, before allocating the format conversion task, the size of the cache space of the cache module is determined first. If the current cache space can satisfy the storage space of the cached data required by the format conversion task, the format conversion task is allocated to the target format conversion module to perform image format conversion. If the current cache space is not enough to support the cache data required by the format conversion task, the allocation of the format conversion task is suspended until the cache space recovers to meet the size of the storage space of the cache data required by the format conversion task, and then the format conversion task is allocated. This ensures that the format conversion task has enough space for buffering, improves the data read and write speed in the image format conversion overshoot, enables the format conversion task to be executed smoothly, and then realizes the dynamic assignment of tasks, improves the format conversion efficiency, and ensures image processing. device reliability.

In some embodiments of the present application, FIG. 4 shows the fourth flow chart of format conversion in an embodiment of the present application, including step 402 and step 404 .

Step 402, determining the process information of the format conversion task.

The process information can be understood as the execution progress of the format conversion task, and the process information includes: task completion information, task progress information, and task interruption information.

Specifically, when the execution progress of the format conversion task reaches a certain progress threshold and the duration reaches the preset time, it is determined that the progress information is the task interruption information; when the execution progress of the format conversion task reaches 100%, the duration reaches the preset time, Then it is determined that the process information is the task completion information. When the execution progress of the format conversion task has not reached 100%, and the duration of a certain progress threshold has not reached the preset time, it is determined that the number conversion task is being executed. At this time, the process information Information for the task.

Step 404 , when the process information is the task completion information or the task interruption information, interrupt the format conversion task, and release the cached data corresponding to the format conversion task in the cache module.

In this embodiment, during the process of format conversion, the current progress information of the format conversion task is determined. If the process information is task completion information or task interruption information, that is, the current format conversion task has been completed or an error occurs, the current format conversion task will be interrupted, and the cached data corresponding to the format conversion task will be released, so as to have enough resources to Execute the next format conversion task to improve resource utilization and ensure the efficiency of image format conversion.

In some embodiments, after the process information is obtained, the process information can be reported to the control device (CPU), so that the control device can record the progress of the format conversion task, so as to facilitate the user to query and trace the image processing process.

In some embodiments of the present application, step 104, before allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, further includes: compressing the target image according to image parameters of the target image.

In this embodiment, for an image with larger resolution, size, and bit width, when the image format conversion is performed, more resources are occupied, and the processing speed is relatively slow. Therefore, before performing the format conversion task, the image occupied space is reduced by image compression, so as to relieve the operation pressure of the format conversion module.

In some embodiments of the present application, step 104, after allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, further includes: decompressing the target image in a compressed state; outputting the decompressed target image image.

In this embodiment, the image parameters before image compression are restored by decompression technology after format conversion. Therefore, the format conversion efficiency can be effectively improved, the real-time requirement of large-resolution image processing can be met, and the usability of the image processing device can be enhanced.

For example, the run-length codec algorithm can be used for compression, and two adjacent pixels with similar color values in the image are identified by two bytes, where the first byte is A count value that specifies the number of times the pixel is repeated; the second byte is the value of the specific pixel. Therefore, the quality of the target image can be guaranteed while compressing.

In some embodiments of the present application, FIG. 5 shows the fifth flowchart of an image processing method according to an embodiment of the present application, including:

Step 502, obtaining the segmentation task of the target image;

Step 504, segment the target image according to the segmentation task of the target image.

In this embodiment, if the user needs to split the target image, a segmentation task for the control device to output the target image is acquired, and the image is segmented according to the segmentation task. Not only can it meet the output quantity requirements of the target image, but also because the size and memory usage of the segmented image block are smaller than the original target image, it can effectively reduce the processing pressure of the format conversion module when performing format conversion on multiple image blocks respectively. Therefore, the format conversion can be performed for the target image with larger resolution, size and bit width, and the speed of the target image format conversion can be increased, the real-time requirement of large-resolution image processing can be met, and the usability of the image processing device can be enhanced.

Specifically, the control device may configure the segmentation task according to the image parameters of the target image, or may configure the segmentation task according to the segmentation instruction input by the user. For example, in the nine-square pattern of the image, the target image can be divided into 9 images equally according to the image size.

In some embodiments of the present application, FIG. 6 shows the sixth flowchart of an image processing method according to an embodiment of the present application, including:

Step 602, acquiring the merging task of the target image;

Step 604, merge the target images according to the merging task of the target images.

In this embodiment, a merging task for the control device to output the target image is acquired, and the images are merged according to the merging task. Among them, the merging process can not only perform the task of synthesizing the segmented image blocks, but also combine multiple complete target images to meet different image requirements of users.

For example, in a panoramic shooting scene, it is necessary to combine multiple images to obtain a panoramic image.

Specifically, the alpha blending (Alpha Blending) technology can be used to merge the target images, and the source pixels and the target pixels can be mixed according to the alpha blending vector, so as to realize the synthesis of the two target images under the condition of ensuring the clarity and fit.

In some embodiments of the present application, as shown in FIG. 7 , the image processing apparatus 700 includes: a plurality of format conversion modules 704, the format conversion modules 704 are used to perform format conversion on the target image; the management module 702, the management module 702 is used for Acquire the target image and the format conversion task of the target image, and assign the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.

In some examples, the format conversion task includes, but is not limited to, at least one of the following: a dimensional format conversion task, a bit-width format conversion task, and a representation format conversion task.

In this embodiment, the image processing apparatus 700 is provided with a plurality of format conversion modules 704, and the plurality of format conversion modules 704 can simultaneously perform the same or different format conversion tasks. When the format conversion of the image is required, the target image to be converted is input to the format conversion module 704, and the management module 702 receives the format conversion task configured by the control device (CPU). The management module 702 assigns different format conversion tasks to the format conversion modules 704 corresponding to the tasks that can be performed. On the one hand, by using a plurality of independent format conversion modules 704 with different functions to perform different format conversion tasks, parallel processing of the format conversion tasks can be realized, which greatly shortens the time required for format conversion, and since different format conversion modules 704 can execute Different format conversion tasks are performed, so that the output target image can take into account the different needs of image processing, realize the format conversion of multi-dimensional images, facilitate multi-dimensional image handling, and improve the format conversion efficiency of the image processing device 700. The control device of the image processing chip performs image format conversion, reduces the resource occupation of the control device when performing the image format conversion, and reduces the operating pressure of the control device while improving the conversion efficiency.

In some implementations, the format conversion module 704 can be set reasonably through different instantiation configurations, for example, it can be set to 5 or 8 and so on.

In some embodiments, as shown in FIG. 8 , the plurality of format conversion modules 704 include at least one of the following: a representation format module 7042, which is used to perform representation format conversion on the target image; a bit-width format module 7044, a bit-width format module 7044, The wide format module 7044 is used for performing bit-width format conversion on the target image; the dimensional format module 7046 is used for performing dimensional format conversion on the target image.

In this embodiment, the format conversion module 704 can configure different format modules according to the format conversion requirements, so as to support the operation of converting multiple target image formats and meet different format requirements during image processing.

In some embodiments, the management module 702 is further configured to assign the format conversion task to the target format conversion module in the idle state.

In some embodiments, as shown in FIG. 9 , the image processing apparatus 700 further includes: a cache module 706 , which is connected to a plurality of format conversion modules 704 , and the cache module 706 is configured to cache the cache data required by the format conversion task.

In this embodiment, the cached data required by the format conversion task is cached by the cache module 706 for reading or re-reading by the format conversion module 704, which speeds up the reading speed of the format conversion module 704 and saves the time for executing the format conversion task. and resources, the operating burden of the format conversion module 704 can be reduced, and when the image processing device 700 fails, data support can still be provided normally within a certain period of time by buffering data to complete the format conversion task and improve the available energy of the image processing device 700. .

It should be noted that different format conversion tasks have different real-time requirements for execution, and require different sizes of the data cache module 706 .

It can be understood that, since each format conversion module 704 requires a certain data buffer area (buffer) in the image format conversion process, multiple format conversion modules 704 can share the cache resources in the cache module 706 to avoid duplicate creation of cached data. , processing and transmission, further saving the time and resources of performing format conversion tasks and ensuring the stability of format conversion.

In some embodiments, the management module 702 is further configured to allocate the format conversion task to the target format conversion module according to the cache space of the cache module 706 .

In this embodiment, before allocating the format conversion task, the size of the cache space of the cache module 706 is determined first. If the current cache space can satisfy the storage space of the cached data required by the format conversion task, the format conversion task is allocated to the target format conversion module to complete the image format conversion. If the current cache space is not enough to support the cache data required by the format conversion task, the allocation of the format conversion task is suspended until the cache space recovers to meet the size of the storage space of the cache data required by the format conversion task, and then the format conversion task is allocated. Therefore, it is ensured that the format conversion task has enough space for buffering, and the data read and write speed in the image format conversion overshoot is improved, so that the format conversion task can be executed smoothly, thereby realizing the dynamic assignment of tasks, and improving the utilization efficiency of the format conversion module 704. , to ensure the reliability of the image processing device 700 .

In some embodiments, the management module 702 is further configured to interrupt the format conversion task according to the process information of the format conversion task, and release the cached data corresponding to the format conversion task in the cache module 706 .

In some embodiments, the image processing apparatus 700 further includes: a segmentation module (not shown in the figure), the segmentation module is configured to segment the target image according to the segmentation task of the target image.

In some embodiments, the image processing apparatus 700 further includes: a synthesizing module (not shown in the figure), the synthesizing module is configured to merge the target images according to the merging task of the target images.

In some embodiments, the image processing apparatus 700 further includes: a compression module (not shown in the figure), the compression module is configured to compress the target image according to the image parameters of the target image, and decompress the target image in a compressed state.

In some embodiments, as shown in FIG. 9 , the image processing apparatus 700 further includes: a transmission module 708, which is configured to transmit the image to a plurality of format conversion modules 704, or transmit the format-converted target image to the target location.

In this embodiment, after the management module 702 assigns the format conversion task to the format conversion module 704, the read back target image is distributed to the format conversion module 704 through the transmission module 708, and the format conversion module 704 will also convert the converted target image to the format conversion module 704. The images are passed to the transfer module 708 to deliver the target image to the target location.

In some embodiments, the target location may be an image processor after format conversion, or may be a display device for displaying the target image, which is not limited in this application.

For example, as shown in FIG. 9 , the related data of the target image performs data read-write interaction through the on-chip network data port. The transmission module 708 will distribute the data read back from the bus to the format conversion modules 704, and at the same time, the image data format conversion modules of each channel will also transmit the processed data to the transmission module 708, and then write to the corresponding data through the on-chip network bus interface. double-rate synchronous (DDR) memory or on-chip static random access memory (SRAM) addresses.

The control device (CPU) configures the format conversion task corresponding to the target image through the configuration port, and sends the event-based format conversion task to the management module 702, and the management module 702 assigns the task to a certain channel of image data format conversion module, which will Carry out the execution of the task, and report an interrupt to the CPU when the task is completed or an error occurs. The shared data cache buffer pool (cache module 706 ) may be shared by the multi-channel image data format conversion module.

In this embodiment, each module of the image processing apparatus 700 implements the steps of the image processing method in any of the above embodiments when performing their respective functions. Therefore, the image processing apparatus 700 also includes the image in any of the above embodiments. All the beneficial effects of the processing method will not be repeated here.

Specifically, the image processing apparatus 700 in this embodiment of the present application may be an apparatus, and may also be a component, an integrated circuit, or a chip in a terminal. The apparatus may be a mobile electronic device or a non-mobile electronic device. Exemplarily, the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant). assistant, PDA), etc., non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.

The image processing apparatus 700 in this embodiment of the present application may be an apparatus having an operating system. The operating system may be an Android (Android) operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.

In some embodiments of the present application, as shown in FIG. 10, an image processing chip 800 includes a processor 804, a memory 802, and programs or instructions stored in the memory 802 and executable on the processor 804. When the instructions are executed by the processor 804, the steps of the image processing method in any of the above embodiments are implemented. Therefore, the image processing chip 800 includes all the beneficial effects of the image processing method provided in any of the above embodiments, and details are not described herein again.

In some embodiments of the present application, as shown in FIG. 11 , the image processing chip 800 includes: a control device 806, connected to the processor 804, for determining and generating a format conversion task according to conversion parameters; an image processor 808, an image The processor 808 is connected with the processor 804 and the control device 806, and the image processor 808 is used to perform image processing on the target image; the memory 802 is connected with the image processor 808 and the control device 806, and the memory 802 is also used for storing format conversion tasks. and data required for image processing.

Specifically, when the electronic device receives the user's first input to the target image, the control device 806 determines the conversion parameters indicated by the first input, and generates a format conversion task according to the conversion parameters, and the control device 806 is responsible for scheduling the entire format conversion task. , so as to perform format conversion on the input target image by the processor 804 dedicated to image format conversion. Therefore, it is no longer necessary for the control device 806 (CPU) to directly process the image data, which greatly improves the efficiency of transferring image data between the internal memory of the electronic device or the on-chip storage devices.

In some embodiments, the conversion parameters include, but are not limited to, at least one of the following: image parameters of the target image, source position of the target image, target position of the target image, format of the target image, target format of the target image, output of the target image number, resolution of the target image, etc.

In some embodiments, the memory 802 includes a static random access memory 8022 (Static Random-access Memory, SRAM) or a double-rate synchronous dynamic random access memory (Double Data Rate Synchronous Dynamic Random-access Memory, DDR SRAM), and a memory control 8024. The data when the control device 806 executes or schedules different graphics-related tasks are saved through the static/dynamic random access memory, and the memory particles 900 outside the image processing chip 800 are read and written through the memory controller 8024 .

Specifically, as shown in FIG. 11 , the image processor 808 includes at least one of the following: an image signal processor 8082 (Imaging Signal Processor, ISP), a video codec (Video Codec), a neural network processor 8084 (Neural -Network Processing Unit, NPU), graphics processor 8086 (Graphics Processing Unit, GPU), digital signal processor 8088 (Digital Signal Processing, DSP). Different image processing functions are implemented by various image processors 808 . A plurality of image processors 808 are interconnected through an on-chip network bus 810 (network on chip, NOC). The control device 806 , the processor 804 and the memory 802 are also mounted on the on-chip network bus 810 .

In some embodiments of the present application, an electronic device is provided, including: the image processing chip of any of the above embodiments, therefore, the electronic device includes all the beneficial effects of the image processing chip provided in any of the above embodiments , and will not be repeated here.

FIG. 12 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application. The electronic device 1200 includes but is not limited to: a radio frequency unit 1202, a network module 1204, an audio output unit 1206, an input unit 1208, a sensor 1210, a display unit 1212, a user input unit 1214, an interface unit 1216, a memory 1218, a processor 1220 and other components .

Those skilled in the art can understand that the electronic device 1200 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1220 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions. The structure of the electronic device shown in FIG. 12 does not constitute a limitation to the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components. In the embodiments of the present application, electronic devices include, but are not limited to, mobile terminals, tablet computers, notebook computers, handheld computers, vehicle-mounted electronic devices, wearable devices, and pedometers.

The processor 1220 acquires the target image and the format conversion task of the target image, and assigns the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.

In some embodiments, the processor 1220 is further configured to assign the format conversion task to the target format conversion module in the idle state.

In some embodiments, the processor 1220 is further configured to read the cache space of the cache module; when the cache space is greater than or equal to a preset threshold, assign the format conversion task of the target image to the target format conversion module.

In some embodiments, the processor 1220 determines the process information of the format conversion task; when the process information is task completion information or task interruption information, interrupts the format conversion task, and releases the cached data corresponding to the format conversion task in the cache module.

In some embodiments, the processor 1220 compresses the target image according to the image parameters of the target image; decompresses the target image in a compressed state; and outputs the decompressed target image.

In some embodiments, the processor 1220 is further configured to obtain a segmentation task of the target image; segment the target image according to the segmentation task of the target image.

In some embodiments, the processor 1220 is further configured to obtain a merging task of the target images; merging the target images according to the merging task of the target images.

It should be understood that, in this embodiment of the present application, the radio frequency unit 1202 may be used to send and receive information or send and receive signals during a call, and specifically, receive downlink data from the base station or send uplink data to the base station. The radio frequency unit 1202 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.

The network module 1204 provides users with wireless broadband Internet access, such as helping users to send and receive emails, browse web pages, and access streaming media.

The audio output unit 1206 may convert audio data received by the radio frequency unit 1202 or the network module 1204 or stored in the memory 1218 into audio signals and output as sound. Also, the audio output unit 1206 may also provide audio output related to a specific function performed by the electronic device 1200 (eg, call signal reception sound, message reception sound, etc.). The audio output unit 1206 includes a speaker, a buzzer, a receiver, and the like.

The input unit 1208 is used to receive audio or video signals. The input unit 1208 may include a graphics processor (Graphics Processing Unit, GPU) 5082 and a microphone 5084, and the graphics processor 5082 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed. The processed image frames may be displayed on the display unit 1212, or stored in the memory 1218 (or other storage medium), or transmitted via the radio frequency unit 1202 or the network module 1204. The microphone 5084 can receive sound, and can process the sound into audio data, and the processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 1202 for output in the case of a telephone call mode.

The electronic device 1200 also includes at least one sensor 1210, such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and other sensors.

The display unit 1212 is used to display information input by the user or information provided to the user. The display unit 1212 may include a display panel 5122, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.

The user input unit 1214 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device. Specifically, the user input unit 1214 includes a touch panel 5142 and other input devices 5144 . The touch panel 5142, also referred to as a touch screen, collects the user's touch operations on or near it. The touch panel 5142 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller. To the processor 1220, the command sent by the processor 1220 is received and executed. Other input devices 5144 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.

In some embodiments, the touch panel 5142 can be overlaid on the display panel 5122. When the touch panel 5142 detects a touch operation on or near it, it transmits it to the processor 1220 to determine the type of the touch event, and then the processor 1220 provides corresponding visual output on display panel 5122 according to the type of touch event. The touch panel 5142 and the display panel 5122 can be used as two independent components, or can be integrated into one component.

The interface unit 1216 is an interface for connecting an external device to the electronic device 1200 . For example, external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more. The interface unit 1216 may be used to receive input (eg, data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 1200 or may be used between the electronic device 1200 and external Transfer data between devices.

Memory 1218 may be used to store application programs and various data. The memory 1218 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data (such as audio data, phone book, etc.) created by the use of the mobile terminal, etc. Additionally, memory 1218 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.

The processor 1220 executes various functions of the electronic device 1200 and processes data by running or executing the application programs and/or modules stored in the memory 1218, and calling the data stored in the memory 1218, so as to perform the overall operation of the electronic device 1200. monitor. The processor 1220 may include one or more processing units; the processor 1220 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes Wireless communication.

In some embodiments of the present application, a readable storage medium is provided, on which programs or instructions are stored, and when the program or instructions are executed by a processor, implement the steps of the image processing method provided in any of the foregoing embodiments .

In this embodiment, the readable storage medium can implement each process of the image processing method provided by the embodiments of the present application, and can achieve the same technical effect, which is not repeated here to avoid repetition.

In some examples, the processor is the processor in the electronic device in the above-described embodiments. Examples of readable storage media include non-transitory computer-readable storage media, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks, or optical disks, and the like.

An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used for running a program or an instruction to implement each process of the above image processing method embodiments, and can achieve the same The technical effect, in order to avoid repetition, will not be repeated here.

It should be understood that the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.

It should be noted that, herein, the terms "comprising", "comprising" or any other variation thereof are intended to encompass non-exclusive inclusion, such that a process, method, article or device comprising a series of elements includes not only those elements, It also includes other elements not expressly listed or inherent to such a process, method, article or apparatus. Without further limitation, an element qualified by the phrase "comprising a..." does not preclude the presence of additional identical elements in a process, method, article or apparatus that includes the element. Furthermore, it should be noted that the scope of the methods and apparatus in the embodiments of the present application is not limited to performing the functions in the order shown or discussed, but may also include performing the functions in a substantially simultaneous manner or in the reverse order depending on the functions involved. To perform functions, for example, the described methods may be performed in an order different from that described, and various steps may also be added, omitted, or combined. Additionally, features described with reference to some examples may be combined in other examples.

From the description of the above embodiments, those skilled in the art can clearly understand that the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation. Based on this understanding, the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.

The embodiments of the present application have been described above in conjunction with the accompanying drawings, but the present application is not limited to the above-mentioned specific embodiments, which are merely illustrative rather than restrictive. Under the inspiration of this application, without departing from the scope of protection of the purpose of this application and the claims, many forms can be made, which all fall within the protection of this application.

The above descriptions are only preferred embodiments of the present application, and are not intended to limit the present application. For those skilled in the art, the present application may have various modifications and changes. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of this application shall be included within the protection scope of this application.

Claims

An image processing method, comprising:

obtaining a target image and a format conversion task for the target image;

The format conversion task of the target image is allocated to a target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.
The image processing method according to claim 1, wherein the assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task comprises:

The format conversion task is allocated to the target format conversion module in an idle state.
The image processing method according to claim 1, wherein the assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task comprises:

Read the cache space of the cache module;

In the case that the buffer space is greater than or equal to a preset threshold, the format conversion task of the target image is allocated to the target format conversion module.
The image processing method according to claim 3, further comprising:

Determine the progress information of the format conversion task, the progress information includes: task completion information, task progress information, and task interruption information;

When the progress information is task completion information or task interruption information, the format conversion task is interrupted, and the cached data corresponding to the format conversion task is released.
The image processing method according to any one of claims 1 to 4, wherein before allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further comprises:

compressing the target image according to the image parameters of the target image;

After allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, the method further includes:

decompressing the target image in a compressed state;

The decompressed target image is output.
The image processing method according to any one of claims 1 to 4, further comprising:

obtaining the segmentation task of the target image;

Segment the target image according to the segmentation task of the target image.
The image processing method according to any one of claims 1 to 4, further comprising:

obtaining the merging task of the target image;

The target images are merged according to the merging task of the target images.
The image processing method according to any one of claims 1 to 4, wherein the format conversion task includes at least one of the following: a dimensional format conversion task, a bit-width format conversion task, and a representation format conversion task.
An image processing device, comprising:

Multiple format conversion modules for format conversion of target images;

A management module, configured to acquire a target image and a format conversion task of the target image, and assign the format conversion task of the target image to a target format conversion module corresponding to the format conversion task.
The image processing apparatus according to claim 9, wherein the plurality of format conversion modules comprise at least one of the following:

a presentation format module for performing presentation format conversion on the target image;

A bit-width format module, used to perform bit-width format conversion on the target image;

A dimension format module, configured to perform dimension format conversion on the target image.
The image processing apparatus according to claim 9, further comprising:

A cache module, configured to cache cache data required by the format conversion task.
The image processing device according to any one of claims 9 to 11, further comprising:

a segmentation module for segmenting the target image according to the segmentation task of the target image; and/or

a synthesis module for merging the target images according to the merging task of the target images; and/or

A compression module, configured to compress the target image according to the image parameters of the target image, and decompress the target image in a compressed state.
The image processing device according to any one of claims 9 to 11, further comprising:

A transmission module, configured to transmit the target image to the plurality of format conversion modules, or transmit the target image after format conversion to a target position.
An image processing chip, comprising a processor, a memory, and a program or an instruction stored on the memory and executable on the processor, the program or the instruction being executed by the processor to achieve as claimed in the claims Steps of the image processing method described in any one of 1 to 8.
The image processing chip according to claim 14, further comprising:

a control device, connected with the processor, the control device is configured to generate a format conversion task according to the conversion parameter;

an image processor, connected with the processor and the control device, and the image processor is used to perform image processing on the target image;

The memory is connected with the image processor and the control device, and the memory is also used for storing the format conversion task and the data required for the image processing.
The image processing chip according to claim 15, wherein the image processor comprises at least one of the following: an image signal processor, a video codec, a neural network processor, a graphics processor, and a digital signal processor.
An electronic device comprising:

The image processing chip according to any one of claims 14 to 16.
An electronic device configured to perform the steps of the image processing method of any one of claims 1 to 8.
A readable storage medium, on which a program or an instruction is stored, and when the program or the instruction is executed by a processor, the steps of the image processing method according to any one of claims 1 to 8 are implemented .
A computer program product, the computer program product being executed by a processor to implement the steps of the image processing method as claimed in any one of claims 1 to 8.
A chip, the chip comprising a processor and a communication interface, the communication interface is coupled to the processor, the processor is used for running a program or an instruction to realize the image according to any one of claims 1 to 8 The steps of the processing method.