WO2022161227A1 - Procédé et appareil de traitement d'image et puce de traitement d'image et dispositif électronique - Google Patents
Procédé et appareil de traitement d'image et puce de traitement d'image et dispositif électronique Download PDFInfo
- Publication number
- WO2022161227A1 WO2022161227A1 PCT/CN2022/072771 CN2022072771W WO2022161227A1 WO 2022161227 A1 WO2022161227 A1 WO 2022161227A1 CN 2022072771 W CN2022072771 W CN 2022072771W WO 2022161227 A1 WO2022161227 A1 WO 2022161227A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- format conversion
- task
- image
- target
- image processing
- Prior art date
Links
- 238000012545 processing Methods 0.000 title claims abstract description 83
- 238000003672 processing method Methods 0.000 title claims abstract description 43
- 238000006243 chemical reaction Methods 0.000 claims abstract description 299
- 238000000034 method Methods 0.000 claims description 37
- 230000011218 segmentation Effects 0.000 claims description 16
- 238000004891 communication Methods 0.000 claims description 7
- 230000005540 biological transmission Effects 0.000 claims description 6
- 230000006835 compression Effects 0.000 claims description 6
- 238000007906 compression Methods 0.000 claims description 6
- 238000004590 computer program Methods 0.000 claims description 4
- 238000013528 artificial neural network Methods 0.000 claims description 3
- 230000015572 biosynthetic process Effects 0.000 claims description 2
- 238000003786 synthesis reaction Methods 0.000 claims description 2
- 230000008569 process Effects 0.000 description 27
- 230000006870 function Effects 0.000 description 17
- 238000010586 diagram Methods 0.000 description 7
- 238000012546 transfer Methods 0.000 description 5
- 230000009286 beneficial effect Effects 0.000 description 4
- 230000003068 static effect Effects 0.000 description 4
- 230000003139 buffering effect Effects 0.000 description 3
- 238000001514 detection method Methods 0.000 description 3
- 238000002156 mixing Methods 0.000 description 3
- 230000001360 synchronised effect Effects 0.000 description 3
- 230000002194 synthesizing effect Effects 0.000 description 3
- 230000000694 effects Effects 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 241000699670 Mus sp. Species 0.000 description 1
- 230000006837 decompression Effects 0.000 description 1
- 238000007599 discharging Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000003993 interaction Effects 0.000 description 1
- 239000004973 liquid crystal related substance Substances 0.000 description 1
- 238000010295 mobile communication Methods 0.000 description 1
- 238000012544 monitoring process Methods 0.000 description 1
- 230000003287 optical effect Effects 0.000 description 1
- 239000002245 particle Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000005236 sound signal Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/80—Camera processing pipelines; Components thereof
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/222—Studio circuitry; Studio devices; Studio equipment
- H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
- H04N5/268—Signal distribution or switching
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/76—Television signal recording
- H04N5/907—Television signal recording using static stores, e.g. storage tubes or semiconductor memories
Definitions
- the present application relates to the technical field of image processing, and in particular, to an image processing method, an image processing apparatus, an image processing chip, an electronic device, and a readable storage medium.
- IPs Intelligent Property, intellectual property
- Multiple IPs process the same image data by pipeline, but the requirements of each IP for the image data format are not fully compatible.
- DMA Direct Memory Access
- DMA Direct Memory Access
- CPU Central Processing Unit
- the embodiments of the present application provide an image processing method, apparatus, image processing chip and electronic device, which can solve the technical problem of low efficiency of general DMA image data processing in the related art.
- an embodiment of the present application provides an image processing method, including:
- the format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.
- an image processing apparatus including:
- the management module is used for acquiring the target image and the format conversion task of the target image, and assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.
- an embodiment of the present application provides an image processing chip, including a processor, a memory, and a program or instruction stored on the memory and running on the processor.
- the program or instruction is executed by the processor, the An aspect provides steps of an image processing method.
- an electronic device including:
- the image processing chip provided by the third aspect.
- an embodiment of the present application provides a readable storage medium, where a program or an instruction is stored on the readable storage medium, and when the program or instruction is executed by a processor, the steps of the image processing method provided in the first aspect are implemented.
- an embodiment of the present application provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is configured to run programs or instructions to implement the steps of the image processing method provided in the first aspect.
- an embodiment of the present application provides an electronic device configured to execute the steps of the image processing method described in the first aspect.
- an embodiment of the present application provides a computer program product, where the computer program product is executed by a processor to implement the steps of the image processing method according to the first aspect.
- the target image and the format conversion task of the target image are obtained; the format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image. Therefore, multiple format conversion modules with different functions can be used to perform different format conversion tasks for the target image to be processed. Even multi-dimensional target images can be efficiently formatted to meet the needs of users for different image formats.
- the control device of the processing chip directly performs image format conversion, which reduces the resource occupation of the control device during format conversion, and reduces the operating pressure of the control device while improving the conversion efficiency.
- FIG. 1 shows one of the flowcharts of an image processing method according to an embodiment of the present application
- FIG. 2 shows the second flowchart of an image processing method according to an embodiment of the present application
- FIG. 3 shows the third flowchart of an image processing method according to an embodiment of the present application
- FIG. 4 shows a fourth flowchart of an image processing method according to an embodiment of the present application
- Fig. 5 shows the fifth flowchart of the image processing method according to an embodiment of the present application
- FIG. 6 shows a sixth flowchart of an image processing method according to an embodiment of the present application.
- FIG. 7 shows one of the structural block diagrams of an image processing apparatus according to an embodiment of the present application.
- FIG. 8 shows the second structural block diagram of an image processing apparatus according to an embodiment of the present application.
- FIG. 9 shows the third structural block diagram of an image processing apparatus according to an embodiment of the present application.
- FIG. 10 shows one of the structural block diagrams of an image processing chip according to an embodiment of the present application.
- FIG. 11 shows the second structural block diagram of an image processing chip according to an embodiment of the present application.
- FIG. 12 shows a schematic diagram of a hardware structure of an electronic device according to an embodiment of the present application.
- FIG. 1 shows one of the flowcharts of an image processing method according to an embodiment of the present application, including step 102 and step 104 .
- Step 102 acquiring the target image and the format conversion task of the target image.
- the format conversion task includes at least one of the following: a dimension format conversion task, a bit-width format conversion task, and a representation format conversion task.
- the dimensional format conversion tasks include: one-dimensional linear data transfer and copy, two-dimensional image data transfer and copy, three-dimensional image data copy transfer and other tasks to perform dimensional format conversion on images of different dimensions. Convert to a 2D image.
- the representation format conversion task includes the mutual conversion between RGB format, YUV format and other image representation formats, for example, RGB565, RGB888, YUV444, YUV422, YUV420 and other image representation formats.
- the target image may be at least one picture, or may be a video, and of course, may also be a picture captured from a video.
- Step 104 Allocate the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, so that the target format conversion module performs format conversion on the target image.
- a format conversion task configured by a control device (CPU) and a target image that needs to be formatted are acquired.
- the format conversion task of the target image is allocated to the target format conversion module corresponding to the format conversion task, and a plurality of format conversion modules with different functions are used to perform different format conversion tasks on the target image to be processed.
- the parallel processing of format conversion tasks can be realized, which greatly shortens the time required for format conversion, and because different format conversion modules can perform different format conversion tasks, the output target image can take into account the different needs of image processing.
- even multi-dimensional images can perform efficient format conversion, which is conducive to multi-dimensional image handling and improves format conversion efficiency.
- the image processing method is applicable to an image processing apparatus, and the image processing apparatus includes a plurality of independent format conversion modules, and each format conversion module of the plurality of format conversion modules can perform the same or different format conversion tasks.
- step 104 assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, including:
- Step 202 Allocate the format conversion task to the target format conversion module in the idle state.
- the usage status of each format conversion module is determined. If the target format conversion module that needs to perform the format conversion task is in an idle state, it means that the target format conversion module can currently perform format conversion. task, the format conversion task is allocated to the target format conversion module in the idle state. If the target format conversion module is in a non-idle state, it means that the target format conversion module is currently performing the format conversion task, then wait for the target format conversion module to be idle before assigning the task, or assign the format conversion to other idle machines that can execute the task. Target format conversion module.
- the parallel format conversion task can be realized, and the format conversion module can be prevented from repeatedly performing the format conversion task, and unnecessary work of the format conversion module can be prevented, so that the dynamic allocation of the format conversion task can be realized, and the utilization efficiency of the format conversion module can be greatly improved.
- step 104 assigning the format conversion task of the target image to the target format conversion module corresponding to the format conversion task includes: step 302 and step 304 .
- Step 302 read the cache space of the cache module.
- the cache module is used to cache the cached data required by the format conversion task for reading or re-reading by the format conversion module, which speeds up the reading speed of the format conversion module and saves time and resources for performing the format conversion task. , which is beneficial to reduce the operating burden of the format conversion module, and when the image processing device fails, data support can still be provided normally within a certain period of time through the cached data, so as to complete the format conversion task and improve the available energy of the image processing device.
- Step 304 when the buffer space is greater than or equal to the preset threshold, assign the format conversion task of the target image to the target format conversion module.
- the size of the cache space of the cache module is determined first. If the current cache space can satisfy the storage space of the cached data required by the format conversion task, the format conversion task is allocated to the target format conversion module to perform image format conversion. If the current cache space is not enough to support the cache data required by the format conversion task, the allocation of the format conversion task is suspended until the cache space recovers to meet the size of the storage space of the cache data required by the format conversion task, and then the format conversion task is allocated.
- FIG. 4 shows the fourth flow chart of format conversion in an embodiment of the present application, including step 402 and step 404 .
- Step 402 determining the process information of the format conversion task.
- the process information can be understood as the execution progress of the format conversion task, and the process information includes: task completion information, task progress information, and task interruption information.
- the process information is the task completion information.
- the execution progress of the format conversion task has not reached 100%, and the duration of a certain progress threshold has not reached the preset time, it is determined that the number conversion task is being executed. At this time, the process information Information for the task.
- Step 404 when the process information is the task completion information or the task interruption information, interrupt the format conversion task, and release the cached data corresponding to the format conversion task in the cache module.
- the current progress information of the format conversion task is determined. If the process information is task completion information or task interruption information, that is, the current format conversion task has been completed or an error occurs, the current format conversion task will be interrupted, and the cached data corresponding to the format conversion task will be released, so as to have enough resources to Execute the next format conversion task to improve resource utilization and ensure the efficiency of image format conversion.
- the process information can be reported to the control device (CPU), so that the control device can record the progress of the format conversion task, so as to facilitate the user to query and trace the image processing process.
- step 104 before allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, further includes: compressing the target image according to image parameters of the target image.
- step 104 after allocating the format conversion task of the target image to the target format conversion module corresponding to the format conversion task, further includes: decompressing the target image in a compressed state; outputting the decompressed target image image.
- the image parameters before image compression are restored by decompression technology after format conversion. Therefore, the format conversion efficiency can be effectively improved, the real-time requirement of large-resolution image processing can be met, and the usability of the image processing device can be enhanced.
- the run-length codec algorithm can be used for compression, and two adjacent pixels with similar color values in the image are identified by two bytes, where the first byte is A count value that specifies the number of times the pixel is repeated; the second byte is the value of the specific pixel. Therefore, the quality of the target image can be guaranteed while compressing.
- FIG. 5 shows the fifth flowchart of an image processing method according to an embodiment of the present application, including:
- Step 502 obtaining the segmentation task of the target image
- Step 504 segment the target image according to the segmentation task of the target image.
- a segmentation task for the control device to output the target image is acquired, and the image is segmented according to the segmentation task.
- the format conversion can be performed for the target image with larger resolution, size and bit width, and the speed of the target image format conversion can be increased, the real-time requirement of large-resolution image processing can be met, and the usability of the image processing device can be enhanced.
- control device may configure the segmentation task according to the image parameters of the target image, or may configure the segmentation task according to the segmentation instruction input by the user.
- the target image can be divided into 9 images equally according to the image size.
- FIG. 6 shows the sixth flowchart of an image processing method according to an embodiment of the present application, including:
- Step 602 acquiring the merging task of the target image
- Step 604 merge the target images according to the merging task of the target images.
- a merging task for the control device to output the target image is acquired, and the images are merged according to the merging task.
- the merging process can not only perform the task of synthesizing the segmented image blocks, but also combine multiple complete target images to meet different image requirements of users.
- the alpha blending (Alpha Blending) technology can be used to merge the target images, and the source pixels and the target pixels can be mixed according to the alpha blending vector, so as to realize the synthesis of the two target images under the condition of ensuring the clarity and fit.
- the image processing apparatus 700 includes: a plurality of format conversion modules 704, the format conversion modules 704 are used to perform format conversion on the target image; the management module 702, the management module 702 is used for Acquire the target image and the format conversion task of the target image, and assign the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.
- the format conversion task includes, but is not limited to, at least one of the following: a dimensional format conversion task, a bit-width format conversion task, and a representation format conversion task.
- the image processing apparatus 700 is provided with a plurality of format conversion modules 704, and the plurality of format conversion modules 704 can simultaneously perform the same or different format conversion tasks.
- the target image to be converted is input to the format conversion module 704, and the management module 702 receives the format conversion task configured by the control device (CPU).
- the management module 702 assigns different format conversion tasks to the format conversion modules 704 corresponding to the tasks that can be performed.
- the control device of the image processing chip performs image format conversion, reduces the resource occupation of the control device when performing the image format conversion, and reduces the operating pressure of the control device while improving the conversion efficiency.
- the format conversion module 704 can be set reasonably through different instantiation configurations, for example, it can be set to 5 or 8 and so on.
- the plurality of format conversion modules 704 include at least one of the following: a representation format module 7042, which is used to perform representation format conversion on the target image; a bit-width format module 7044, a bit-width format module 7044, The wide format module 7044 is used for performing bit-width format conversion on the target image; the dimensional format module 7046 is used for performing dimensional format conversion on the target image.
- the format conversion module 704 can configure different format modules according to the format conversion requirements, so as to support the operation of converting multiple target image formats and meet different format requirements during image processing.
- the management module 702 is further configured to assign the format conversion task to the target format conversion module in the idle state.
- the image processing apparatus 700 further includes: a cache module 706 , which is connected to a plurality of format conversion modules 704 , and the cache module 706 is configured to cache the cache data required by the format conversion task.
- the cached data required by the format conversion task is cached by the cache module 706 for reading or re-reading by the format conversion module 704, which speeds up the reading speed of the format conversion module 704 and saves the time for executing the format conversion task. and resources, the operating burden of the format conversion module 704 can be reduced, and when the image processing device 700 fails, data support can still be provided normally within a certain period of time by buffering data to complete the format conversion task and improve the available energy of the image processing device 700. .
- each format conversion module 704 requires a certain data buffer area (buffer) in the image format conversion process
- multiple format conversion modules 704 can share the cache resources in the cache module 706 to avoid duplicate creation of cached data. , processing and transmission, further saving the time and resources of performing format conversion tasks and ensuring the stability of format conversion.
- the management module 702 is further configured to allocate the format conversion task to the target format conversion module according to the cache space of the cache module 706 .
- the size of the cache space of the cache module 706 is determined first. If the current cache space can satisfy the storage space of the cached data required by the format conversion task, the format conversion task is allocated to the target format conversion module to complete the image format conversion. If the current cache space is not enough to support the cache data required by the format conversion task, the allocation of the format conversion task is suspended until the cache space recovers to meet the size of the storage space of the cache data required by the format conversion task, and then the format conversion task is allocated.
- the format conversion task has enough space for buffering, and the data read and write speed in the image format conversion overshoot is improved, so that the format conversion task can be executed smoothly, thereby realizing the dynamic assignment of tasks, and improving the utilization efficiency of the format conversion module 704. , to ensure the reliability of the image processing device 700 .
- the management module 702 is further configured to interrupt the format conversion task according to the process information of the format conversion task, and release the cached data corresponding to the format conversion task in the cache module 706 .
- the image processing apparatus 700 further includes: a segmentation module (not shown in the figure), the segmentation module is configured to segment the target image according to the segmentation task of the target image.
- the image processing apparatus 700 further includes: a synthesizing module (not shown in the figure), the synthesizing module is configured to merge the target images according to the merging task of the target images.
- the image processing apparatus 700 further includes: a compression module (not shown in the figure), the compression module is configured to compress the target image according to the image parameters of the target image, and decompress the target image in a compressed state.
- a compression module (not shown in the figure)
- the compression module is configured to compress the target image according to the image parameters of the target image, and decompress the target image in a compressed state.
- the image processing apparatus 700 further includes: a transmission module 708, which is configured to transmit the image to a plurality of format conversion modules 704, or transmit the format-converted target image to the target location.
- a transmission module 708 which is configured to transmit the image to a plurality of format conversion modules 704, or transmit the format-converted target image to the target location.
- the management module 702 assigns the format conversion task to the format conversion module 704
- the read back target image is distributed to the format conversion module 704 through the transmission module 708, and the format conversion module 704 will also convert the converted target image to the format conversion module 704.
- the images are passed to the transfer module 708 to deliver the target image to the target location.
- the target location may be an image processor after format conversion, or may be a display device for displaying the target image, which is not limited in this application.
- the related data of the target image performs data read-write interaction through the on-chip network data port.
- the transmission module 708 will distribute the data read back from the bus to the format conversion modules 704, and at the same time, the image data format conversion modules of each channel will also transmit the processed data to the transmission module 708, and then write to the corresponding data through the on-chip network bus interface.
- double-rate synchronous (DDR) memory or on-chip static random access memory (SRAM) addresses are examples of the data read-write interaction through the on-chip network data port.
- DDR double-rate synchronous
- SRAM static random access memory
- the control device configures the format conversion task corresponding to the target image through the configuration port, and sends the event-based format conversion task to the management module 702, and the management module 702 assigns the task to a certain channel of image data format conversion module, which will Carry out the execution of the task, and report an interrupt to the CPU when the task is completed or an error occurs.
- the shared data cache buffer pool (cache module 706 ) may be shared by the multi-channel image data format conversion module.
- each module of the image processing apparatus 700 implements the steps of the image processing method in any of the above embodiments when performing their respective functions. Therefore, the image processing apparatus 700 also includes the image in any of the above embodiments. All the beneficial effects of the processing method will not be repeated here.
- the image processing apparatus 700 in this embodiment of the present application may be an apparatus, and may also be a component, an integrated circuit, or a chip in a terminal.
- the apparatus may be a mobile electronic device or a non-mobile electronic device.
- the mobile electronic device may be a mobile phone, a tablet computer, a notebook computer, a palmtop computer, an in-vehicle electronic device, a wearable device, an ultra-mobile personal computer (UMPC), a netbook, or a personal digital assistant (personal digital assistant).
- UMPC ultra-mobile personal computer
- netbook or a personal digital assistant
- non-mobile electronic devices can be servers, network attached storage (Network Attached Storage, NAS), personal computer (personal computer, PC), television (television, TV), teller machine or self-service machine, etc., this application Examples are not specifically limited.
- Network Attached Storage NAS
- personal computer personal computer, PC
- television television
- teller machine or self-service machine etc.
- the image processing apparatus 700 in this embodiment of the present application may be an apparatus having an operating system.
- the operating system may be an Android (Android) operating system, an iOS operating system, or other possible operating systems, which are not specifically limited in the embodiments of the present application.
- an image processing chip 800 includes a processor 804, a memory 802, and programs or instructions stored in the memory 802 and executable on the processor 804. When the instructions are executed by the processor 804, the steps of the image processing method in any of the above embodiments are implemented. Therefore, the image processing chip 800 includes all the beneficial effects of the image processing method provided in any of the above embodiments, and details are not described herein again.
- the image processing chip 800 includes: a control device 806, connected to the processor 804, for determining and generating a format conversion task according to conversion parameters; an image processor 808, an image
- the processor 808 is connected with the processor 804 and the control device 806, and the image processor 808 is used to perform image processing on the target image
- the memory 802 is connected with the image processor 808 and the control device 806, and the memory 802 is also used for storing format conversion tasks. and data required for image processing.
- the control device 806 determines the conversion parameters indicated by the first input, and generates a format conversion task according to the conversion parameters, and the control device 806 is responsible for scheduling the entire format conversion task. , so as to perform format conversion on the input target image by the processor 804 dedicated to image format conversion. Therefore, it is no longer necessary for the control device 806 (CPU) to directly process the image data, which greatly improves the efficiency of transferring image data between the internal memory of the electronic device or the on-chip storage devices.
- the conversion parameters include, but are not limited to, at least one of the following: image parameters of the target image, source position of the target image, target position of the target image, format of the target image, target format of the target image, output of the target image number, resolution of the target image, etc.
- the memory 802 includes a static random access memory 8022 (Static Random-access Memory, SRAM) or a double-rate synchronous dynamic random access memory (Double Data Rate Synchronous Dynamic Random-access Memory, DDR SRAM), and a memory control 8024.
- SRAM Static Random-access Memory
- DDR SRAM Double-rate synchronous dynamic random access memory
- the data when the control device 806 executes or schedules different graphics-related tasks are saved through the static/dynamic random access memory, and the memory particles 900 outside the image processing chip 800 are read and written through the memory controller 8024 .
- the image processor 808 includes at least one of the following: an image signal processor 8082 (Imaging Signal Processor, ISP), a video codec (Video Codec), a neural network processor 8084 (Neural -Network Processing Unit, NPU), graphics processor 8086 (Graphics Processing Unit, GPU), digital signal processor 8088 (Digital Signal Processing, DSP).
- image signal processor 8082 Imaging Signal Processor, ISP
- video codec Video Codec
- NPU Neurological -Network Processing Unit
- graphics processor 8086 Graphics Processing Unit, GPU
- digital signal processor 8088 Digital Signal Processing, DSP
- Different image processing functions are implemented by various image processors 808 .
- a plurality of image processors 808 are interconnected through an on-chip network bus 810 (network on chip, NOC).
- the control device 806 , the processor 804 and the memory 802 are also mounted on the on-chip network bus 810 .
- an electronic device including: the image processing chip of any of the above embodiments, therefore, the electronic device includes all the beneficial effects of the image processing chip provided in any of the above embodiments , and will not be repeated here.
- FIG. 12 is a schematic diagram of a hardware structure of an electronic device implementing an embodiment of the present application.
- the electronic device 1200 includes but is not limited to: a radio frequency unit 1202, a network module 1204, an audio output unit 1206, an input unit 1208, a sensor 1210, a display unit 1212, a user input unit 1214, an interface unit 1216, a memory 1218, a processor 1220 and other components .
- the electronic device 1200 may also include a power source (such as a battery) for supplying power to various components, and the power source may be logically connected to the processor 1220 through a power management system, so as to manage charging, discharging, and power management through the power management system. consumption management and other functions.
- a power source such as a battery
- the structure of the electronic device shown in FIG. 12 does not constitute a limitation to the electronic device, and the electronic device may include more or less components than those shown, or combine some components, or arrange different components.
- electronic devices include, but are not limited to, mobile terminals, tablet computers, notebook computers, handheld computers, vehicle-mounted electronic devices, wearable devices, and pedometers.
- the processor 1220 acquires the target image and the format conversion task of the target image, and assigns the format conversion task of the target image to the target format conversion module corresponding to the format conversion task.
- the processor 1220 is further configured to assign the format conversion task to the target format conversion module in the idle state.
- the processor 1220 is further configured to read the cache space of the cache module; when the cache space is greater than or equal to a preset threshold, assign the format conversion task of the target image to the target format conversion module.
- the processor 1220 determines the process information of the format conversion task; when the process information is task completion information or task interruption information, interrupts the format conversion task, and releases the cached data corresponding to the format conversion task in the cache module.
- the processor 1220 compresses the target image according to the image parameters of the target image; decompresses the target image in a compressed state; and outputs the decompressed target image.
- the processor 1220 is further configured to obtain a segmentation task of the target image; segment the target image according to the segmentation task of the target image.
- the processor 1220 is further configured to obtain a merging task of the target images; merging the target images according to the merging task of the target images.
- the radio frequency unit 1202 may be used to send and receive information or send and receive signals during a call, and specifically, receive downlink data from the base station or send uplink data to the base station.
- the radio frequency unit 1202 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier, a duplexer, and the like.
- the network module 1204 provides users with wireless broadband Internet access, such as helping users to send and receive emails, browse web pages, and access streaming media.
- the audio output unit 1206 may convert audio data received by the radio frequency unit 1202 or the network module 1204 or stored in the memory 1218 into audio signals and output as sound. Also, the audio output unit 1206 may also provide audio output related to a specific function performed by the electronic device 1200 (eg, call signal reception sound, message reception sound, etc.).
- the audio output unit 1206 includes a speaker, a buzzer, a receiver, and the like.
- the input unit 1208 is used to receive audio or video signals.
- the input unit 1208 may include a graphics processor (Graphics Processing Unit, GPU) 5082 and a microphone 5084, and the graphics processor 5082 is used for still pictures or video images obtained by an image capture device (such as a camera) in a video capture mode or an image capture mode data is processed.
- the processed image frames may be displayed on the display unit 1212, or stored in the memory 1218 (or other storage medium), or transmitted via the radio frequency unit 1202 or the network module 1204.
- the microphone 5084 can receive sound, and can process the sound into audio data, and the processed audio data can be converted into a format that can be transmitted to a mobile communication base station via the radio frequency unit 1202 for output in the case of a telephone call mode.
- the electronic device 1200 also includes at least one sensor 1210, such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and other sensors.
- a sensor 1210 such as a fingerprint sensor, pressure sensor, iris sensor, molecular sensor, gyroscope, barometer, hygrometer, thermometer, infrared sensor, light sensor, motion sensor, and other sensors.
- the display unit 1212 is used to display information input by the user or information provided to the user.
- the display unit 1212 may include a display panel 5122, which may be configured in the form of a liquid crystal display, an organic light emitting diode, or the like.
- the user input unit 1214 may be used to receive input numerical or character information, and generate key signal input related to user settings and function control of the electronic device.
- the user input unit 1214 includes a touch panel 5142 and other input devices 5144 .
- the touch panel 5142 also referred to as a touch screen, collects the user's touch operations on or near it.
- the touch panel 5142 may include two parts, a touch detection device and a touch controller. Among them, the touch detection device detects the user's touch orientation, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, and then sends it to the touch controller.
- Other input devices 5144 may include, but are not limited to, physical keyboards, function keys (such as volume control keys, switch keys, etc.), trackballs, mice, and joysticks, which are not described herein again.
- the touch panel 5142 can be overlaid on the display panel 5122.
- the touch panel 5142 detects a touch operation on or near it, it transmits it to the processor 1220 to determine the type of the touch event, and then the processor 1220 provides corresponding visual output on display panel 5122 according to the type of touch event.
- the touch panel 5142 and the display panel 5122 can be used as two independent components, or can be integrated into one component.
- the interface unit 1216 is an interface for connecting an external device to the electronic device 1200 .
- external devices may include wired or wireless headset ports, external power (or battery charger) ports, wired or wireless data ports, memory card ports, ports for connecting devices with identification modules, audio input/output (I/O) ports, video I/O ports, headphone ports, and more.
- the interface unit 1216 may be used to receive input (eg, data information, power, etc.) from external devices and transmit the received input to one or more elements within the electronic device 1200 or may be used between the electronic device 1200 and external Transfer data between devices.
- Memory 1218 may be used to store application programs and various data.
- the memory 1218 may mainly include a stored program area and a stored data area, wherein the stored program area may store an operating system, an application program required for at least one function (such as a sound playback function, an image playback function, etc.), etc.; Data (such as audio data, phone book, etc.) created by the use of the mobile terminal, etc.
- memory 1218 may include high-speed random access memory, and may also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- the processor 1220 executes various functions of the electronic device 1200 and processes data by running or executing the application programs and/or modules stored in the memory 1218, and calling the data stored in the memory 1218, so as to perform the overall operation of the electronic device 1200. monitor.
- the processor 1220 may include one or more processing units; the processor 1220 may integrate an application processor and a modem processor, wherein the application processor mainly processes the operating system, user interface and application programs, etc., and the modem processor mainly processes Wireless communication.
- a readable storage medium on which programs or instructions are stored, and when the program or instructions are executed by a processor, implement the steps of the image processing method provided in any of the foregoing embodiments .
- the readable storage medium can implement each process of the image processing method provided by the embodiments of the present application, and can achieve the same technical effect, which is not repeated here to avoid repetition.
- the processor is the processor in the electronic device in the above-described embodiments.
- readable storage media include non-transitory computer-readable storage media, such as computer read-only memory (Read-Only Memory, ROM), random access memory (Random Access Memory, RAM), magnetic disks, or optical disks, and the like.
- An embodiment of the present application further provides a chip, where the chip includes a processor and a communication interface, the communication interface is coupled to the processor, and the processor is used for running a program or an instruction to implement each process of the above image processing method embodiments, and can achieve the same The technical effect, in order to avoid repetition, will not be repeated here.
- the chip mentioned in the embodiments of the present application may also be referred to as a system-on-chip, a system-on-chip, a system-on-a-chip, or a system-on-a-chip, or the like.
- the method of the above embodiment can be implemented by means of software plus a necessary general hardware platform, and of course can also be implemented by hardware, but in many cases the former is better implementation.
- the technical solution of the present application can be embodied in the form of a software product in essence or in a part that contributes to the prior art, and the computer software product is stored in a storage medium (such as ROM/RAM, magnetic disk, CD-ROM), including several instructions to make a terminal (which may be a mobile phone, a computer, a server, an air conditioner, or a network device, etc.) execute the methods described in the various embodiments of this application.
- a storage medium such as ROM/RAM, magnetic disk, CD-ROM
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Image Processing (AREA)
Abstract
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202110111128.5A CN112887608A (zh) | 2021-01-27 | 2021-01-27 | 图像处理方法、装置、图像处理芯片和电子设备 |
CN202110111128.5 | 2021-01-27 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022161227A1 true WO2022161227A1 (fr) | 2022-08-04 |
Family
ID=76052743
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2022/072771 WO2022161227A1 (fr) | 2021-01-27 | 2022-01-19 | Procédé et appareil de traitement d'image et puce de traitement d'image et dispositif électronique |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN112887608A (fr) |
WO (1) | WO2022161227A1 (fr) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN117750025A (zh) * | 2024-02-20 | 2024-03-22 | 上海励驰半导体有限公司 | 一种图像数据处理方法、装置、芯片、设备及介质 |
WO2024109004A1 (fr) * | 2022-11-22 | 2024-05-30 | 华为技术有限公司 | Procédé de traitement de données et système sur puce |
Families Citing this family (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN112887608A (zh) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | 图像处理方法、装置、图像处理芯片和电子设备 |
CN113867817B (zh) * | 2021-09-24 | 2024-09-17 | 深圳Tcl新技术有限公司 | 一种数据处理方法、装置、电子设备和存储介质 |
CN117237461A (zh) * | 2022-06-08 | 2023-12-15 | 中兴通讯股份有限公司 | 一种色彩空间转换方法及电子设备、存储介质 |
CN118042291B (zh) * | 2024-04-12 | 2024-06-21 | 杭州海康威视数字技术股份有限公司 | 图像终端管理方法及装置 |
Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050206784A1 (en) * | 2001-07-31 | 2005-09-22 | Sha Li | Video input processor in multi-format video compression system |
US20080158364A1 (en) * | 2004-05-20 | 2008-07-03 | Hiroshi Miyajima | Image Processing Device and Data Processing Method |
CN105430236A (zh) * | 2015-12-22 | 2016-03-23 | 北京天诚盛业科技有限公司 | 图像输出格式快速转换的方法 |
US20160277492A1 (en) * | 2015-03-16 | 2016-09-22 | International Business Machines Corporation | Image file transmission |
CN109005421A (zh) * | 2018-08-17 | 2018-12-14 | 青岛海信电器股份有限公司 | 图像处理方法及装置、计算机可读存储介质 |
CN109246478A (zh) * | 2018-11-20 | 2019-01-18 | 郑州云海信息技术有限公司 | 一种视频格式转换装置及方法 |
CN112165572A (zh) * | 2020-09-10 | 2021-01-01 | Oppo(重庆)智能科技有限公司 | 图像处理方法、装置、终端及存储介质 |
CN112887608A (zh) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | 图像处理方法、装置、图像处理芯片和电子设备 |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104182279A (zh) * | 2014-02-26 | 2014-12-03 | 无锡天脉聚源传媒科技有限公司 | 一种任务调度方法、装置及系统 |
CN106611432B (zh) * | 2015-10-21 | 2020-09-04 | 深圳市腾讯计算机系统有限公司 | 一种图片格式转换方法、装置和系统 |
-
2021
- 2021-01-27 CN CN202110111128.5A patent/CN112887608A/zh active Pending
-
2022
- 2022-01-19 WO PCT/CN2022/072771 patent/WO2022161227A1/fr active Application Filing
Patent Citations (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050206784A1 (en) * | 2001-07-31 | 2005-09-22 | Sha Li | Video input processor in multi-format video compression system |
US20080158364A1 (en) * | 2004-05-20 | 2008-07-03 | Hiroshi Miyajima | Image Processing Device and Data Processing Method |
US20160277492A1 (en) * | 2015-03-16 | 2016-09-22 | International Business Machines Corporation | Image file transmission |
CN105430236A (zh) * | 2015-12-22 | 2016-03-23 | 北京天诚盛业科技有限公司 | 图像输出格式快速转换的方法 |
CN109005421A (zh) * | 2018-08-17 | 2018-12-14 | 青岛海信电器股份有限公司 | 图像处理方法及装置、计算机可读存储介质 |
CN109246478A (zh) * | 2018-11-20 | 2019-01-18 | 郑州云海信息技术有限公司 | 一种视频格式转换装置及方法 |
CN112165572A (zh) * | 2020-09-10 | 2021-01-01 | Oppo(重庆)智能科技有限公司 | 图像处理方法、装置、终端及存储介质 |
CN112887608A (zh) * | 2021-01-27 | 2021-06-01 | 维沃移动通信有限公司 | 图像处理方法、装置、图像处理芯片和电子设备 |
Cited By (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2024109004A1 (fr) * | 2022-11-22 | 2024-05-30 | 华为技术有限公司 | Procédé de traitement de données et système sur puce |
CN117750025A (zh) * | 2024-02-20 | 2024-03-22 | 上海励驰半导体有限公司 | 一种图像数据处理方法、装置、芯片、设备及介质 |
CN117750025B (zh) * | 2024-02-20 | 2024-05-10 | 上海励驰半导体有限公司 | 一种图像数据处理方法、装置、芯片、设备及介质 |
Also Published As
Publication number | Publication date |
---|---|
CN112887608A (zh) | 2021-06-01 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2022161227A1 (fr) | Procédé et appareil de traitement d'image et puce de traitement d'image et dispositif électronique | |
WO2022037251A1 (fr) | Procédé et appareil de traitement de données vidéo | |
KR100890236B1 (ko) | 카메라핸드폰을 컴퓨터의 카메라로 사용하여비디오데이터를 취득하는 방법 | |
US9232177B2 (en) | Video chat data processing | |
CN112235579B (zh) | 视频处理方法、计算机可读存储介质及电子设备 | |
US9508109B2 (en) | Graphics processing | |
US20240292009A1 (en) | Method and apparatus for processing video compression, and medium | |
WO2023125657A1 (fr) | Procédé et appareil de traitement d'image, et dispositif électronique | |
WO2024074012A1 (fr) | Procédé, appareil et dispositif de commande de transmission vidéo, et support de stockage lisible non volatil | |
JP5870145B2 (ja) | カラーバッファ圧縮 | |
CN114285957A (zh) | 图像处理电路及数据传输方法 | |
US20160358590A1 (en) | System on Chip Devices and Operating Methods Thereof | |
CN117435532B (zh) | 基于视频硬件加速接口的拷贝方法、装置及存储介质 | |
TWI526050B (zh) | 擷取多個視訊頻道以供視訊分析及編碼之技術 | |
WO2019196634A1 (fr) | Procédé et appareil de traitement de données | |
US12061662B2 (en) | Methods, apparatuses and systems for displaying alarm file | |
CN111741343A (zh) | 视频处理方法及装置、电子设备 | |
CN111447439A (zh) | 图像编码方法、图像编码装置及移动终端 | |
US20160085348A1 (en) | Application host with distributed remote input and output interfaces | |
WO2022061723A1 (fr) | Procédé de traitement d'images, dispositif, terminal, et support d'informations | |
US8688799B2 (en) | Methods, apparatuses and computer program products for reducing memory copy overhead by indicating a location of requested data for direct access | |
JP2022525911A (ja) | 外部メモリの協調アクセス方法及びシステム、協調アクセスアーキテクチャ | |
WO2024199320A1 (fr) | Procédé de traitement d'image basé sur une mémoire cache de système, et appareil associé | |
CN118592021A (zh) | 用于处理视频的电子设备及其操作方法 | |
CN117827416A (zh) | 视频的多进程处理方法、装置、计算机设备和存储介质 |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 22745102 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22745102 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 17-01-2024) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 22745102 Country of ref document: EP Kind code of ref document: A1 |