WO2025021079A1 - 图像处理系统、方法、电子设备、可读存储介质和芯片 - Google Patents

图像处理系统、方法、电子设备、可读存储介质和芯片 Download PDF

Info

Publication number
WO2025021079A1
WO2025021079A1 PCT/CN2024/106853 CN2024106853W WO2025021079A1 WO 2025021079 A1 WO2025021079 A1 WO 2025021079A1 CN 2024106853 W CN2024106853 W CN 2024106853W WO 2025021079 A1 WO2025021079 A1 WO 2025021079A1
Authority
WO
WIPO (PCT)
Prior art keywords
image processing
processing chip
service module
layer
framework layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
PCT/CN2024/106853
Other languages
English (en)
French (fr)
Inventor
曾达彬
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Vivo Mobile Communication Co Ltd
Original Assignee
Vivo Mobile Communication Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Vivo Mobile Communication Co Ltd filed Critical Vivo Mobile Communication Co Ltd
Publication of WO2025021079A1 publication Critical patent/WO2025021079A1/zh
Anticipated expiration legal-status Critical
Pending legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING OR CALCULATING; COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T1/00—General purpose image data processing
    • G06T1/20—Processor architectures; Processor configuration, e.g. pipelining

Definitions

  • the present application relates to the field of image processing, and in particular to an image processing system, method, electronic device, readable storage medium and chip.
  • an image processing chip can be added to the electronic device.
  • the control layer of the image processing chip is usually set in the camera hardware abstraction layer of the system-on-chip (SoC), so that the SoC can call the image processing chip for image processing.
  • SoC system-on-chip
  • the image processing chip is applied to electronic devices, it is usually necessary to write interactive logic code to facilitate the normal interaction between the SoC and the image processing chip.
  • the internal camera hardware abstraction layer is usually different. As a result, users have a large difference in user experience when using different electronic device models.
  • the present application provides an image processing system, method, electronic device, readable storage medium and chip, which can solve the problem that there are large differences in user experience when using different electronic device models.
  • an embodiment of the present application provides an image processing system, the system comprising:
  • An image processing chip and a hardware abstraction layer wherein the image processing chip is communicatively connected with the hardware abstraction layer;
  • a manufacturer framework layer and an application framework layer wherein the manufacturer framework layer is communicatively connected with the hardware abstraction layer and the application framework layer respectively;
  • the manufacturer framework layer is also connected to the image processing chip for communication, and the manufacturer framework layer is used to perform communication control on the image processing chip.
  • an embodiment of the present application provides an image processing method, which is applied to the image processing system described in the first aspect, and the method includes:
  • the manufacturer framework layer When the manufacturer framework layer receives the first image data stream output by the camera hardware abstraction module, the manufacturer framework layer controls the The commercial framework layer transmits the first image data stream to the image processing chip;
  • the image processing chip is controlled to transmit the second image data stream to the manufacturer framework layer.
  • an embodiment of the present application provides an electronic device, comprising a processor and a memory, wherein the memory stores programs or instructions that can be run on the processor, and when the programs or instructions are executed by the processor, the steps of the image processing method described in the second aspect are implemented.
  • an embodiment of the present application provides a readable storage medium, on which a program or instruction is stored, and when the program or instruction is executed by a processor, the steps of the image processing method described in the second aspect are implemented.
  • an embodiment of the present application provides a chip, comprising a processor and a communication interface, wherein the communication interface and the processor are coupled, and the processor is used to run a program or instruction to implement the steps of the image processing method described in the second aspect.
  • the image processing system in the embodiment of the present application includes: an image processing chip, a hardware abstraction layer, a manufacturer framework layer and an application framework layer, wherein the image processing chip is connected to the hardware abstraction layer in communication; the manufacturer framework layer is connected to the hardware abstraction layer and the application framework layer in communication; the manufacturer framework layer is also connected to the image processing chip in communication, and the manufacturer framework layer is used to communicate and control the image processing chip.
  • the manufacturer framework layer is connected to the hardware abstraction layer and the application framework layer in communication, so that some functional modules of the hardware abstraction layer are moved up to the manufacturer framework layer, so that the functional modules after the upward movement can be independently called by the application framework layer, without being bound to the camera hardware abstraction module, and not depending on the development of the camera hardware abstraction module, and after decoupling, the chip can be upgraded independently, and can be quickly adapted when a new platform is introduced.
  • the problem of large differences in the use experience when using different electronic equipment models can be solved, so that the user's experience of using different electronic equipment models is unified, instead of the difference in memory usage and power consumption caused by the difference in processing solutions due to platform differences.
  • FIG1 is a schematic diagram of the structure of an image processing system provided by the present application.
  • FIG2 is a schematic diagram of a flow chart of an image processing method provided by the present application.
  • FIG3 is a schematic diagram of the structure of an electronic device provided in an embodiment of the present application.
  • FIG. 4 is a schematic diagram of the hardware structure of an electronic device provided in an embodiment of the present application.
  • first, second, etc. in the specification and claims of this application are used to distinguish similar objects, and are not used to describe a specific order or sequence. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.
  • the objects distinguished by “first”, “second”, etc. are generally of one type, and the number of objects is not limited.
  • the first object can be one or more.
  • “and/or” in the specification and claims means at least one of the connected objects, and the character “/” generally means that the objects connected before and after are in an “or” relationship.
  • Application layer (Applications): The application layer consists of all applications running on Android devices, including pre-installed system applications and third-party applications installed by users.
  • the application framework layer is the core of Android application development, providing a basic application programming interface (API) framework for developers to develop applications.
  • ART System runtime layer, class libraries or Android runtime (Android Runtime, ART), class libraries encapsulate a series of function libraries for use by the upper layer; ART is composed of Java core class libraries (Core Libraries) and Android virtual machine (Dalvik).
  • HAL Hardware Abstraction Layer
  • the Linux kernel layer is the foundation of the Android system, mainly implementing memory management, progress scheduling, inter-process communication, device drivers, etc.
  • FIG. 1 is a schematic diagram of the structure of an image processing system provided in an embodiment of the present application, wherein the image processing system includes:
  • An image processing chip and a hardware abstraction layer wherein the image processing chip is communicatively connected with the hardware abstraction layer;
  • a manufacturer framework layer and an application framework layer wherein the manufacturer framework layer is communicatively connected with the hardware abstraction layer and the application framework layer respectively;
  • the manufacturer framework layer is also connected to the image processing chip for communication, and the manufacturer framework layer is used to perform communication control on the image processing chip.
  • the above-mentioned image processing system may be an image processing system in an electronic device, and the electronic device may be various types of user terminals, such as a mobile phone, a tablet computer, etc., or the electronic device may also be a device developed by a manufacturer.
  • the above-mentioned image processing system may also include an SoC in an electronic device.
  • the above-mentioned image processing chip is a chip in the electronic device other than the SoC for processing images.
  • the image processing chip may also be referred to as an image enhancement chip or a plug-in chip.
  • it may be selected to further perform image enhancement processing on the image output by the SoC based on the image processing chip to improve the processing effect of the image.
  • the above-mentioned image processing chip may be used to perform the following processing on the image: denoising processing, clarity adjustment processing, white balance processing, etc.
  • the SoC may be used to perform the following processing on the image: stylization processing, watermarking processing, denoising processing, etc.
  • the hardware abstraction layer may include a camera hardware abstraction module, and the hardware abstraction layer may include a camera hardware abstraction module.
  • the hardware abstraction module is communicatively connected with the manufacturer framework layer.
  • the camera hardware abstraction module is a standard module provided by Google.
  • the SoC of each platform in order to realize the control of the image processing chip, the SoC of each platform usually stores the control logic of the image processing chip in the camera hardware abstraction module. Since the image processing logic of different platforms may be different, the camera hardware abstraction modules in different platforms are different.
  • the hardware abstraction layer in the SoC corresponding to each platform can communicate with the image processing chip based on the manufacturer framework layer, that is, there is no need to set the control logic of the corresponding image processing chip in the camera hardware abstraction module in the hardware abstraction layer in the SoC corresponding to each platform, that is, there is no need to modify the camera hardware abstraction module during the development process, so that the SoC of each platform has the same camera hardware abstraction module.
  • the SoCs of various platforms can share a set of interaction codes for interacting with the manufacturer's framework layer.
  • the camera hardware abstraction modules of different platforms can interact with the image processing chip through the manufacturer's framework layer, thereby avoiding the problem of repeatedly writing a set of interaction logic.
  • the above-mentioned manufacturer framework layer can also be called the Original Equipment Manufacturer (OEM) framework layer, which is a functional module in the electronic device that is independent of the SoC.
  • OEM Original Equipment Manufacturer
  • the customized code in each platform can be pre-stored in the manufacturer framework layer.
  • HDR High Dynamic Range
  • different platform manufacturers will provide self-developed HDR algorithms, and the code of the self-developed HDR algorithm can be transplanted to the manufacturer framework layer.
  • the above-mentioned platforms may specifically include various types of SoC development platforms.
  • the application framework layer may be an application framework layer in an Android system framework, for example, the application framework layer may be a Google framework layer (Google Framework). It is understood that the application framework layer may establish a communication connection between the manufacturer framework layer and the application layer.
  • Google Framework Google Framework
  • the communication control of the image processing chip by the manufacturer framework layer may refer to the control logic of the image processing chip or the data transmission control of the input/output (I/O) channel.
  • the above-mentioned manufacturer framework layer links the application framework layer in the form of Android Interface Definition Language (AIDL) on the data path, and defines a common interface for the camera module, thereby correspondingly implementing configuration data streams, processing acquisition requests, etc.
  • the manufacturer framework layer can establish a transfer mechanism for image data streams and metadata within the layer, thereby forwarding the image data stream transmitted from the hardware abstraction layer to the application framework layer.
  • the manufacturer framework layer is communicated with the hardware abstraction layer and the application framework layer, so that some functional modules of the hardware abstraction layer are moved up to the manufacturer framework layer, so that the moved functional modules can be independently called by the application framework layer without being bound to the camera hardware abstraction module. It is fixed and does not rely on the development of the camera hardware abstraction module. After decoupling, the chip can be upgraded independently and can be quickly adapted when a new platform is introduced. Thereby, the problem of large differences in the user experience when using different electronic equipment models is solved, so that users have a unified experience when using different electronic equipment models, instead of differences in memory usage and power consumption due to differences in processing solutions caused by platform differences.
  • the manufacturer framework layer includes a first camera service module and a display hardware synthesizer
  • the first camera service module is used to perform communication control on the image processing chip through the hardware abstraction layer;
  • the display hardware synthesizer is used to transmit the preview image stream to the image processing chip under the control of the application framework layer.
  • the first camera service module may be a vendor camera service module (Vendor Camera Server).
  • the display hardware synthesizer may be a hardware composition abstraction layer (HWComposer, HWC).
  • a communication control path is formed between the first camera service module of the manufacturer framework layer, the hardware abstraction layer and the image processing chip, so that the image data stream can be input to the first camera service module through the hardware abstraction layer after being output from the image sensor, or the data stream can be input to the first camera service module through the hardware abstraction layer after being output from the image processing chip.
  • the preview image stream may refer to image data to be sent to the display screen for display during the image capture process of the electronic device.
  • the preview image stream is sent to the display hardware synthesizer via the application framework layer, and the preview image stream is output to the image processing chip through the display hardware synthesizer, and then transmitted to the display device for preview display through the image processing chip.
  • the image processing chip can be controlled for communication through the hardware abstraction layer based on the manufacturer framework layer, and on the other hand, the preview image stream can be transmitted to the image processing chip based on the manufacturer framework layer.
  • the communication control between the image sensor and the image processing chip and the manufacturer framework layer and the preview requirements of the upper layer application are transmitted to the image processing chip through the manufacturer framework layer.
  • the image processing system may also include an image sensor, a hardware layer and a kernel layer.
  • the kernel layer includes a video device driver (video for linux 2, V4L2).
  • the hardware layer includes a port CSI0 of the image sensor.
  • the port CSI0 of the image sensor is connected to the camera hardware abstract module through V4L2.
  • the image sensor may sequentially transmit the image data stream collected by the image sensor to the camera hardware abstract module through the ports CSI0 and V4L2.
  • the camera hardware abstract module may transmit the image data stream to the manufacturer framework layer.
  • the manufacturer framework layer may transmit the received image data stream to the image processing chip so that the image processing chip can process the image.
  • the manufacturer framework layer may also transmit the image data stream received from the image processing chip to the application framework layer so that the image can be displayed or stored based on the application framework layer.
  • the hardware abstraction layer includes a camera hardware abstraction module, and the first camera service module is connected to the image processing chip through the display hardware synthesizer to form a first data transmission path;
  • the image processing chip is connected to the first camera service module through a camera hardware abstraction module to form a second data transmission path.
  • the above-mentioned camera hardware abstraction module can be a camera hardware abstraction layer (Camera Hardware Abstraction Layer, Camera HAL).
  • the kernel layer also includes a display direct rendering manager driver (Direct Rendering Manager Driver, DRM Driver), the first camera service module is connected to the port DSI1 of the image processing chip through the display hardware synthesizer and the DRM Driver in turn, thereby forming a first data transmission path.
  • the image processing chip is connected to the first camera service module through the port CSI1 of the image sensor, V4L2 of the kernel layer, and Camera Hal in turn, thereby forming a second data transmission path.
  • the first camera service module can transmit the image data stream to be processed to the image processing chip through the first data transmission path for image processing.
  • the image processing chip can transmit the processed image data back to the first camera service module through the second data transmission path.
  • system further comprises a display screen, a memory and an application layer;
  • the application framework layer includes a second camera service module, a display framework module and a media codec;
  • the above-mentioned second camera service module can be a Google camera service (Google Camera Server);
  • the above-mentioned display framework module can be a Surface Flinger, which runs in the system process of the Android framework and is responsible for managing the frame buffer (Frame Buffer) of the Android system;
  • the above-mentioned media codec can be a media codec (Media Codec).
  • the first camera service module is connected to the display screen through the second camera service module, the application layer, the display framework module, the display hardware synthesizer, and the image processing chip in sequence to form a third data transmission path;
  • the first camera service module is connected to the display screen through the second camera service module, the application layer, the display framework module, the display hardware synthesizer, the DRM Driver, the image processing chip, and the display processor (Display Processing Unit, DPU) in sequence to form a third data transmission path.
  • the display framework module the display hardware synthesizer, the DRM Driver, the image processing chip, and the display processor (Display Processing Unit, DPU) in sequence to form a third data transmission path.
  • DPU Display Processing Unit
  • the first camera service module can transmit the processed image to the display screen through the third data transmission path for preview display.
  • the first camera service module is connected to the memory via the second camera service module and the media codec in sequence to form a fourth data transmission path.
  • the first camera service module is connected to the memory interface (UFS/sMMC) through the second camera service module, the media codec, the open multimedia acceleration module (Open Media Acceleration, OMX), and the data block driver module (Block Driver) in sequence to form a fourth data transmission path.
  • the fourth data transmission path is formed so that the first camera service module can transmit the processed image to the memory for storage through the fourth data transmission path.
  • the image processing system also includes an application layer
  • the application framework layer includes a display enhancement service module
  • the manufacturer framework layer also includes an image processing chip hardware abstraction module.
  • the application layer is connected to the image processing chip through the display enhancement service module and the image processing chip hardware abstraction module in sequence to form a first control path.
  • the display enhancement service module can be the display enhanced service (Display Enhanced Service) of the Google framework layer
  • the image processing chip hardware abstraction module can be an application specific integrated circuit hardware abstraction layer (Application Specific Integrated Circuit Hardware Abstraction Layer, ASIC HAL).
  • the application layer is connected to the SPI of the image processing chip through the display enhancement service module, the image processing chip hardware abstraction module, and the serial peripheral interface driver (Serial Peripheral Interface Driver, SPI Driver) in sequence to form the first control path.
  • serial peripheral interface driver Serial Peripheral Interface Driver, SPI Driver
  • the first control path can be conveniently used to control the state of the image processing chip based on the corresponding control in the user interface.
  • a display enhancement switch can be set in the display interface, and the user can turn on or off the display enhancement switch as needed to facilitate the user to improve the image quality of the displayed interface.
  • the specific interface can specifically refer to a game interface or a shooting preview interface, etc.
  • the first camera service module can first transmit the image that needs to be transmitted to the display screen for display to the image processing chip through the above-mentioned first data transmission path for display enhancement, and the image processing chip then transmits the enhanced image to the first camera service module through the second data transmission path, and the first camera service module then transmits the enhanced image to the display screen based on the third data transmission path for display.
  • the user can control the state of the image processing chip through the control in the user interface.
  • the manufacturer framework layer further includes an image processing chip hardware abstraction module, and the first camera service module is connected to the image processing chip through the image processing chip hardware abstraction module to form a second control path.
  • the first camera service module can be connected to the SPI of the image processing chip through the image processing chip hardware abstraction module and SPI Driver in sequence to form the second control path.
  • the first camera service module can control the state of the image processing chip through the second control path.
  • the image processing chip when the image processing chip is in the display enhancement mode, the image processing chip is notified through the first control path and the second control path to perform color enhancement on the preview image stream.
  • the image processing chip when the video recording is finished, the image processing chip is notified to finish the operation through the first control path and the second control path, thereby saving the operating power consumption of the electronic device.
  • FIG. 2 is a flow chart of an image processing method provided in an embodiment of the present application.
  • the image processing method is applied to the image processing system described in the above embodiment.
  • the following steps of the method include:
  • Step 201 When the manufacturer framework layer receives a first image data stream output by a camera hardware abstraction module, control the manufacturer framework layer to transmit the first image data stream to the image processing chip;
  • Step 202 Control the image processing chip to perform image processing on the first image data stream to obtain a second image data stream.
  • Step 203 Control the image processing chip to transmit the second image data stream to the manufacturer framework layer.
  • the above-mentioned image processing chip may specifically perform image processing on the first image data stream by using common image processing means in related technologies.
  • the first image data stream may be processed as follows: denoising, clarity adjustment, and white balance.
  • the image sensor transmits the collected first image data stream to the hardware abstraction module through the kernel layer, and then transmits it to the manufacturer framework layer through the hardware abstraction module, and then controls the manufacturer framework layer to transmit the first image data stream to the image processing chip through the kernel layer; controls the image processing chip to perform image processing on the first image data stream to obtain a second image data stream; and then controls the image processing chip to transmit the second image data stream to the manufacturer framework layer through the kernel layer and the hardware abstraction layer.
  • the manufacturer framework layer can be controlled to realize the output data of the image sensor and the input and output control of the image processing chip, so that the control logic and data path of the image processing chip can be controlled through the manufacturer framework layer.
  • the image processing method provided in this embodiment is an image processing method corresponding to the above-mentioned image processing system, the image processing method has all the beneficial effects of the above-mentioned image processing system.
  • the manufacturer framework layer includes a first camera service module and a display hardware synthesizer, and the first camera service module is connected to the image processing chip through the display hardware synthesizer to form a first data transmission path;
  • the controlling the manufacturer framework layer to transmit the first image data stream to the image processing chip comprises:
  • the first camera service module in the manufacturer framework layer is controlled to transmit the first image data stream to the image processing chip through the first data transmission path.
  • the first camera service module can transmit the first image data stream to the image processing chip through the first data transmission path for image processing.
  • the first image data stream may be image data collected by the image sensor, and the image sensor may sequentially transmit the first image data stream to the Camera Hal through ports CSI0 and V4L2. After receiving the first image data stream, the Camera Hal may transmit the first image data stream to the manufacturer framework layer.
  • the manufacturer framework layer transmits the first image data stream to the image processing chip through DMR Driver and DSI1.
  • the image processing chip is connected to the first camera service module through the camera hardware abstraction module to form a second data transmission path;
  • the controlling the image processing chip to transmit the second image data stream to the manufacturer framework layer comprises:
  • the image processing chip is controlled to transmit the second image data stream to the first camera service module in the manufacturer framework layer through the second data transmission path.
  • the image processing chip can return the second image data stream to the first camera service module through the second data transmission path.
  • the image processing chip outputs the second image data stream to the vendor Camera Server of the vendor framework layer through CSI1, V4L2, and Camera HAL.
  • system further comprises a display screen, a memory and an application layer, wherein the application framework layer comprises a second camera server. service module, display framework module and media codec.
  • the first camera service module is connected to the display screen through the second camera service module, the application layer, the display framework module, the display hardware synthesizer, and the image processing chip in sequence to form a third data transmission path;
  • the method further includes:
  • the first camera service module is controlled to transmit the second image data stream to the display screen through the third data transmission path for preview display.
  • the first camera service module is controlled to transmit the second image data stream to the display screen for preview display based on the third data transmission path.
  • the second image data stream is output by the first camera service module of the vendor framework layer, passes through the second camera service module of the application framework layer, passes through the application layer, and is input to the display framework module of the hardware framework layer, and then output to the display hardware synthesizer of the vendor framework layer, and is driven by the display direct rendering manager of the kernel layer, and then input to the image processing chip through DSI0, and then input to the display screen through the display processor for display, thereby realizing the preview display of the image data stream.
  • the first camera service module is connected to the memory via the second camera service module and the media codec in sequence to form a fourth data transmission path;
  • the method further includes:
  • the first camera service module is controlled to transmit the second image data stream to the memory for storage through the fourth data transmission path.
  • the first camera service module can also be controlled to transmit the second image data stream to the memory for storage based on the fourth data transmission path.
  • the second image data stream is output by the first camera service module of the manufacturer framework layer, passes through the second camera service module of the application framework layer, passes through the media decoder of the application framework layer, the open multimedia acceleration module of the hardware abstraction layer, and the data block driver of the kernel layer, and then is output to the memory for storage through UFS/sMMC.
  • the image data stream can be photographed or recorded for storage at the same time.
  • system further includes an application layer
  • application framework layer includes a display enhancement service module
  • manufacturer framework layer further includes an image processing chip hardware abstraction module
  • the application layer is connected to the image processing chip through the display enhancement service module and the image processing chip hardware abstraction module in sequence to form a first control path;
  • the method further comprises:
  • the application layer is controlled to send a first control instruction to the image processing chip through the first control path, where the first control instruction is used to control the image processing chip to perform image enhancement processing on the image data stream.
  • a display enhancement switch can be set in the display interface, so that the user can turn on or off the display enhancement switch as needed to facilitate the user to improve the image quality of the displayed interface.
  • the first input may be an input of a user turning on the display enhancement switch in the display interface, or may be a voice input of the user.
  • the specific interface may be a game interface or a shooting interface.
  • the first camera service module can first transmit the image that needs to be transmitted to the display screen for display to the image processing chip through the above-mentioned first data transmission path for display enhancement, and the image processing chip then transmits the image data stream after display enhancement to the first camera service module through the second data transmission path, and the first camera service module then transmits the image data stream after display enhancement to the display screen based on the third data transmission path for display.
  • the user can control the state of the image processing chip through the user interface displayed by the electronic device.
  • the manufacturer framework layer further includes a first camera service module and an image processing chip hardware abstraction module;
  • the first camera service module is connected to the image processing chip through the image processing chip hardware abstraction module to form a second control path;
  • the method further comprises:
  • the first camera service module is controlled to send a second control instruction to the image processing chip through the second control path, and the second control instruction is used to control the image processing chip to end the video data stream processing.
  • the electronic device when it receives the start input for starting the recording function, it can send a third control instruction to the image processing chip through the second control path based on the second image data stream processing unit, wherein the third control instruction is used to control the image processing chip to start up.
  • the first camera service module may be pre-configured with the control logic for triggering the second control instruction and the third control instruction.
  • the above-mentioned input for ending the recording and input for starting the recording function may be inputs made by the user in an application interface displayed by the electronic device.
  • the image processing chip can be controlled to start based on the third control instruction, so as to perform image enhancement on the recorded data stream based on the image processing chip, thereby improving the recording quality; correspondingly, when the electronic device only displays a preview image and does not need to record, the image processing chip can be disabled to save power consumption of the electronic device.
  • an embodiment of the present application also provides an electronic device 300, including a processor 301, a memory 302, and a program or instruction stored in the memory 302 and executable on the processor 301.
  • a program or instruction stored in the memory 302 and executable on the processor 301.
  • the program or instruction is executed by the processor 301, each process of the above-mentioned image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the interface display device in the embodiment of the present application includes the mobile electronic device and the non-mobile electronic device mentioned above.
  • processors involved in the present application may include general-purpose processors, special-purpose processors, etc., such as central processing units (CPU), microprocessors, digital signal processors (DSP), artificial intelligence (AI) processors, graphics processors (Graphics Processors, etc.
  • CPU central processing units
  • DSP digital signal processors
  • AI artificial intelligence
  • GPU GPU
  • ASIC Application Specific Integrated Circuit
  • NP Network Processor
  • FPGA Field Programmable Gate Array
  • FIG. 4 is a schematic diagram of the hardware structure of an electronic device implementing an embodiment of the present application.
  • the electronic device 400 includes but is not limited to components such as a radio frequency unit 401 , a network module 402 , an audio output unit 403 , an input unit 404 , a sensor 405 , a display unit 406 , a user input unit 407 , an interface unit 408 , a memory 409 , and a processor 410 .
  • the processor 410 is used to control the manufacturer framework layer to transmit the first image data stream to the image processing chip when the manufacturer framework layer receives the first image data stream output by the camera hardware abstraction module;
  • the image processing chip is controlled to transmit the second image data stream to the manufacturer framework layer.
  • the manufacturer framework layer includes a first camera service module and a display hardware synthesizer, and the first camera service module is connected to the image processing chip through the display hardware synthesizer to form a first data transmission path;
  • the image processing chip is connected to the first camera service module through the camera hardware abstraction module to form a second data transmission path;
  • the processor 410 is specifically configured to control the first camera service module in the manufacturer framework layer to transmit the first image data stream to the image processing chip through the first data transmission path;
  • the processor 410 is specifically configured to control the image processing chip to transmit the second image data stream to the first camera service module in the manufacturer framework layer through the second data transmission path.
  • it further includes a display unit 406, a memory 409 and an application layer, wherein the application framework layer includes a second camera service module, a display framework module and a media codec;
  • the first camera service module is connected to the display unit 406 through the second camera service module, the application layer, the display framework module, the display hardware synthesizer, and the image processing chip in sequence to form a third data transmission path;
  • the first camera service module is connected to the memory 409 in sequence through the second camera service module and the media codec to form a fourth data transmission path;
  • the processor 410 is further configured to control the first camera service module to transmit the second image data stream to the display unit 406 for display through the third data transmission path;
  • the processor 410 is further configured to control the first camera service module to transmit the second image data stream to the memory 409 for storage through the fourth data transmission path.
  • the application framework layer includes a display enhancement service module
  • the manufacturer framework layer also includes an image processing chip hardware abstraction module
  • the application layer is connected to the image processing chip through the display enhancement service module and the image processing chip hardware abstraction module in sequence to form a first control path;
  • the processor 410 is further used to, upon receiving a first input, control the application layer to send a first control instruction to the image processing chip through the first control path, wherein the first control instruction is used to control the image processing chip to perform image enhancement processing on the image data stream.
  • the manufacturer framework layer further includes a first camera service module and an image processing chip hardware abstraction module;
  • the first camera service module is connected to the image processing chip through the image processing chip hardware abstraction module to form a second control path;
  • the processor 410 is also used to control the first camera service module to send a second control instruction to the image processing chip through the second control path when the system is in a video data stream processing state and receives a video recording end input, and the second control instruction is used to control the image processing chip to end video data stream processing.
  • the electronic device 400 may also include a power source (such as a battery) for supplying power to each component, and the power source may be logically connected to the processor 410 through a power management system, so that the power management system can manage charging, discharging, and power consumption.
  • a power source such as a battery
  • the electronic device structure shown in FIG4 does not constitute a limitation on the electronic device, and the electronic device may include more or fewer components than shown, or combine certain components, or arrange components differently, which will not be described in detail here.
  • the input unit 404 may include a graphics processing unit (GPU) 4041 and a microphone 4042, and the graphics processor 4041 processes the image data of the static picture or video obtained by the image capture device (such as a camera) in the video capture mode or the image capture mode.
  • the display unit 406 may include a display panel 4061, and the display panel 4061 may be configured in the form of a liquid crystal display, an organic light emitting diode, etc.
  • the user input unit 407 includes a touch panel 4071 and at least one of other input devices 4072.
  • the touch panel 4071 is also called a touch screen.
  • the touch panel 4071 may include two parts: a touch detection device and a touch controller.
  • Other input devices 4072 may include, but are not limited to, a physical keyboard, function keys (such as a volume control key, a switch key, etc.), a trackball, a mouse, and a joystick, which will not be repeated here.
  • the memory 409 can be used to store software programs and various data.
  • the memory 409 may mainly include a first storage area for storing programs or instructions and a second storage area for storing data, wherein the first storage area may store an operating system, an application program or instructions required for at least one function (such as a sound playback function, an image playback function, etc.), etc.
  • the memory 409 may include a volatile memory or a non-volatile memory, or the memory 409 may include both volatile and non-volatile memories.
  • the non-volatile memory may be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), or a flash memory.
  • Volatile memory can be random access memory (RAM), static random access memory (SRAM), dynamic random access memory (DRAM), synchronous dynamic random access memory (SDRAM), double data rate synchronous dynamic random access memory (DDRSDRAM), enhanced synchronous dynamic random access memory (ESDRAM), synchronous link dynamic random access memory (SLDRAM) and direct memory bus random access memory.
  • RAM random access memory
  • SRAM static random access memory
  • DRAM dynamic random access memory
  • SDRAM synchronous dynamic random access memory
  • DDRSDRAM double data rate synchronous dynamic random access memory
  • ESDRAM enhanced synchronous dynamic random access memory
  • SLDRAM synchronous link dynamic random access memory
  • the memory 409 in the embodiment of the present application includes but is not limited to these and any other suitable types
  • the processor 410 may include one or more processing units; optionally, the processor 410 integrates an application processor and a modem processor, wherein the application processor mainly processes operations related to an operating system, a user interface, and application programs, and the modem processor mainly processes wireless communication signals, such as a baseband processor. It is understandable that the modem processor may not be integrated into the processor 410.
  • An embodiment of the present application also provides a readable storage medium, on which a program or instruction is stored.
  • a program or instruction is stored.
  • the program or instruction is executed by a processor, each process of the above-mentioned image processing method embodiment is implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.
  • the processor is the processor in the electronic device described in the above embodiment.
  • the readable storage medium includes a computer readable storage medium, such as a computer read-only memory ROM, a random access memory RAM, a magnetic disk or an optical disk.
  • An embodiment of the present application further provides a chip, which includes a processor and a communication interface, wherein the communication interface is coupled to the processor, and the processor is used to run programs or instructions to implement the various processes of the above-mentioned image processing method embodiment, and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the chip mentioned in the embodiments of the present application can also be called a system-level chip, a system chip, a chip system or a system-on-chip chip, etc.
  • An embodiment of the present application provides a computer program product, which is stored in a storage medium.
  • the program product is executed by at least one processor to implement the various processes of the above-mentioned image processing method embodiment and can achieve the same technical effect. To avoid repetition, it will not be repeated here.
  • the technical solution of the present application can essentially or in other words, the part that makes the contribution can be embodied in the form of a computer software product, which is stored in a storage medium (such as ROM/RAM, a disk, or an optical disk), and includes a number of instructions for a terminal (which can be a mobile phone, a computer, a server, or a network device, etc.) to execute the methods described in each embodiment of the present application.
  • a storage medium such as ROM/RAM, a disk, or an optical disk
  • a terminal which can be a mobile phone, a computer, a server, or a network device, etc.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Studio Devices (AREA)

Abstract

本申请提供了一种图像处理系统、方法、电子设备、可读存储介质和芯片，所述图像处理系统包括图像处理芯片和硬件抽象层，所述图像处理芯片与所述硬件抽象层通信连接；厂商框架层和应用框架层，所述厂商框架层分别与所述硬件抽象层和所述应用框架层通信连接；所述厂商框架层还与所述图像处理芯片通信连接，所述厂商框架层用于对所述图像处理芯片进行通信控制。

Description

图像处理系统、方法、电子设备、可读存储介质和芯片
本申请要求于2023年07月27日提交中国专利局、申请号为202310938352.0、发明名称为“图像处理系统、方法、电子设备、可读存储介质和芯片”的中国专利申请的优先权，其全部内容通过引用结合在本申请中。
技术领域
本申请涉及图像处理领域，具体涉及一种图像处理系统、方法、电子设备、可读存储介质和芯片。
背景技术
随着通信技术的发展，电子设备中的功能越来越强大，例如，用户可以使用电子设备拍摄图像。然而，采用现有的电子设备进行拍摄的过程中，所拍摄的图像的质量在一定程度上取决于外界拍摄环境，当外界影响拍摄的干扰因素较多时，所拍摄得到的图像通常不理想。
为了提高电子设备的拍摄质量，相关技术中提出了可以在电子设备内增设图像处理芯片，相关技术中，通常会将图像处理芯片的控制层设置于系统级芯片(System on Chip，SoC)的相机硬件抽象层中，以便于SoC调用图像处理芯片进行图像处理。在将图像处理芯片应用于电子设备时，通常需要通过编写交互逻辑代码以便于SoC与图像处理芯片之间的能够正常交互，然而，当需要将同一图像处理芯片应用于不同平台提供的SoC时，由于不同类型的SoC，其内部的相机硬件抽象层通常存在一定的区别。从而导致用户使用不同的电子设备机型存在使用体验存在较大差异的问题。
发明内容
本申请提供了一种图像处理系统、方法、电子设备、可读存储介质和芯片，可以解决使用不同的电子设备机型存在使用体验存在较大差异的问题。
第一方面，本申请实施例提供了一种图像处理系统，所述系统包括：
图像处理芯片和硬件抽象层，所述图像处理芯片与所述硬件抽象层通信连接；
厂商框架层和应用框架层，所述厂商框架层分别与所述硬件抽象层和所述应用框架层通信连接；
所述厂商框架层还与所述图像处理芯片通信连接，所述厂商框架层用于对所述图像处理芯片进行通信控制。
第二方面，本申请实施例提供了一种图像处理方法，应用于第一方面所述的图像处理系统，所述方法包括：
在厂商框架层接收到相机硬件抽象模块输出的第一图像数据流的情况下，控制所述厂 商框架层将所述第一图像数据流传输至所述图像处理芯片；
控制所述图像处理芯片对所述第一图像数据流进行图像处理，得到第二图像数据流；以及，
控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层。
第三方面，本申请实施例提供了一种电子设备，包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如第二方面所述的图像处理方法的步骤。
第四方面，本申请实施例提供了一种可读存储介质，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如第二方面所述的图像处理方法的步骤。
第五方面，本申请实施例提供了一种芯片，所述芯片包括处理器和通信接口，其中，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如第二方面所述的图像处理方法的步骤。
本申请实施例中的图像处理系统包括：图像处理芯片、硬件抽象层、厂商框架层和应用框架层，其中，图像处理芯片与硬件抽象层通信连接；厂商框架层分别与硬件抽象层和应用框架层通信连接；厂商框架层还与图像处理芯片通信连接，所述厂商框架层用于对所述图像处理芯片进行通信控制。因此，通过在安卓框架系统中增加厂商框架层，该厂商框架层与硬件抽象层和应用框架层通信连接，实现将硬件抽象层的部分功能模块上移至厂商框架层，使得上移后的功能模块能够独立的被应用框架层调用，而不需要与相机硬件抽象模块绑定，不依赖于相机硬件抽象模块的开发，且解耦后可以独立进行芯片升级，在新平台引入的情况下能够快速适配。从而，可以解决使用不同的电子设备机型存在使用体验存在较大差异的问题，使得用户使用不同的电子设备机型的体验统一，而不是由于平台差异，导致处理方案差异而出现内存占用、功耗差异。
附图说明
图1是本申请提供的一种图像处理系统的结构示意图；
图2是本申请提供的一种图像处理方法的流程示意图；
图3是本申请实施例提供的一种电子设备的结构示意图；
图4是本申请实施例提供的电子设备的硬件结构示意图。
具体实施方式
下面将结合本申请实施例中的附图，对本申请实施例中的技术方案进行清楚地描述，显然，所描述的实施例是本申请一部分实施例，而不是全部的实施例。基于本申请中的实施例，本领域普通技术人员获得的所有其他实施例，都属于本申请保护的范围。
本申请的说明书和权利要求书中的术语“第一”、“第二”等是用于区别类似的对象，而不用于描述特定的顺序或先后次序。应该理解这样使用的数据在适当情况下可以互换， 以便本申请的实施例能够以除了在这里图示或描述的那些以外的顺序实施，且“第一”、“第二”等所区分的对象通常为一类，并不限定对象的个数，例如第一对象可以是一个，也可以是多个。此外，说明书以及权利要求中“和/或”表示所连接对象的至少其中之一，字符“/”，一般表示前后关联对象是一种“或”的关系。
下面结合附图，通过具体的实施例及其应用场景对本申请实施例提供的图像处理系统、方法、电子设备、可读存储介质和芯片进行详细地说明。
为了便于理解，先对本申请实施例中涉及的安卓(Android)系统框架结构进行介绍。
应用层(Applications)，应用层由运行在Android设备上的所有应用构成，包括预装的系统应用和用户安装的第三方应用。
应用框架层(Application Framework)，是Android应用开发的核心，为开发者开发应用是提供基础的应用程序接口(Application Programming Interface，API)框架。
系统运行库层，类库Libraries或安卓运行时(Android Runtime，ART)，类库Libraries通过封装一系列的函数库供上层使用；ART是由Java核心类库(Core Libraries)和Android虚拟机(Dalvik)共同构成。
硬件抽象层(Hardware Abstraction Layer，HAL)，位于操作系统内核与硬件电路之间的接口层，其目的在于将硬件抽象化。
Linux内核层，是Android系统的基础，主要实现内存管理、进度调度、进程间通信、设备驱动等。
下面请参见图1，图1是本申请实施例提供的一种图像处理系统的结构示意图，所述图像处理系统包括：
图像处理芯片和硬件抽象层，所述图像处理芯片与所述硬件抽象层通信连接；
厂商框架层和应用框架层，所述厂商框架层分别与所述硬件抽象层和所述应用框架层通信连接；
所述厂商框架层还与所述图像处理芯片通信连接，所述厂商框架层用于对所述图像处理芯片进行通信控制。
上述图像处理系统可以是电子设备中的图像处理系统，所述电子设备可以是各种类型的用户终端，例如，手机、平板电脑等，或者，所述电子设备也可以是厂商的开发设备。
上述图像处理系统还可以包括电子设备中的SoC，上述图像处理芯片为电子设备中除SoC之外的用于对图像进行处理的芯片，图像处理芯片也可称为图像增强芯片或外挂芯片。具体地，在图像处理系统对图像进行处理的过程中，可以在基于SoC对图像进行处理的基础上，选择进一步基于图像处理芯片对SoC输出的图像进行图像增强处理，以提高对图像的处理效果。例如，上述图像处理芯片可以用于对图像进行如下处理：去噪处理、清晰度调节处理和白平衡处理等。所述SoC可以用于对图像进行如下处理：风格化处理、添加水印处理、去噪处理等。
上述硬件抽象层可以包括相机硬件抽象模块，所述硬件抽象层具体可以通过所述相机 硬件抽象模块与所述厂商框架层通信连接。
其中，所述相机硬件抽象模块为谷歌提供的标准模块，相关技术中，各个平台的SoC为了实现对图像处理芯片的控制，通常是通过在相机硬件抽象模块中存储图像处理芯片的控制逻辑，由于不同平台的图像处理逻辑可能存在差异，从而导致不同平台中的相机硬件抽象模块存在差异。而本申请实施例中，各个平台对应的SoC中的硬件抽象层可以基于所述厂商框架层与图像处理芯片通信，即无需在各个平台对应的SoC中的硬件抽象层中的相机硬件抽象模块内设置对应的图像处理芯片的控制逻辑，即在开发过程中无需对相机硬件抽象模块进行修改，使得各个平台的SoC具有相同的相机硬件抽象模块。
由于各个平台的SoC具有相同的相机硬件抽象模块，因此，各个平台的SoC可以共用一套与厂商框架层进行交互的交互代码，在图像处理芯片跨平台开发时，仅需编写一次图像处理芯片与第一相机服务模块之间的逻辑交互代码，这样，不同平台的相机硬件抽象模块可以通过所述厂商框架层与图像处理芯片进行交互，从而避免了针对一套交互逻辑需要重复编写多遍的问题。从而，解决使用不同的电子设备机型存在使用体验存在较大差异的问题，使得用户使用不同的电子设备机型的体验统一，而不是由于平台差异，导致处理方案差异而出现内存占用、功耗差异。
上述厂商框架层也可以称为原始设备制造商(Original Equipment Manufacturer，OEM)框架层，该厂商框架层为电子设备中独立于SoC之外的功能模块。所述厂商框架层中可以预先存储各个平台中的客制化代码。具体地，如高动态范围(High Dynamic Range，HDR)拍照算法，不同的平台厂商会提供自研HDR算法，可以将该自研HDR算法的代码移植到厂商框架层。
以便于厂商框架层能够建立各个平台的SoC与图像处理芯片之间的通信连接。
上述各个平台具体可以包括各种类型的SoC开发平台。
上述应用框架层可以是Android系统框架中的应用框架层，例如，所述应用框架层可以是谷歌框架层(Google Framework)。可以理解的是，所述应用框架层可以建立所述厂商框架层与应用层之间的通信连接。
需要说明的是，厂商框架层对图像处理芯片进行通信控制可以指图像处理芯片的控制逻辑或输入/输出(Input/Output，I/O)通道的数据传输控制。
上述厂商框架层在数据通路上以安卓接口定义语言(Android Interface Definition Language，AIDL)的方式链接应用框架层，并对相机模块定义通用接口，从而对应实现配置数据流(configure streams)、处理采集请求(process capture request)等。厂商框架层可以建立该层内部对图像数据流和元数据(metadata)的中转机制，从而实现对硬件抽象层传输上来的图像数据流转发给应用框架层。
在本申请实施例中，通过在Android框架系统中增加厂商框架层，该厂商框架层与硬件抽象层和应用框架层通信连接，实现将硬件抽象层的部分功能模块上移至厂商框架层，使得上移后的功能模块能够独立的被应用框架层调用，而不需要与相机硬件抽象模块绑 定，不依赖于相机硬件抽象模块的开发，且解耦后可以独立进行芯片升级，在新平台引入的情况下能够快速适配。从而，解决使用不同的电子设备机型存在使用体验存在较大差异的问题，使得用户使用不同的电子设备机型的体验统一，而不是由于平台差异，导致处理方案差异而出现内存占用、功耗差异。同时，在图像处理芯片跨平台开发时，仅需编写一次图像处理芯片与厂商框架层之间的逻辑交互代码，不同平台的硬件抽象层可以基于厂商框架层对图像处理芯片进行控制，从而提高了图像处理芯片跨平台开发的效率。
可选地，所述厂商框架层包括第一相机服务模块和显示硬件合成器；
所述第一相机服务模块用于通过所述硬件抽象层对所述图像处理芯片进行通信控制；
所述显示硬件合成器用于在所述应用框架层的控制下，将预览图像流传输给所述图像处理芯片。
上述第一相机服务模块可以为供应商相机服务模块(Vendor Camera Server)。上述显示硬件合成器可以为硬件组合抽象层(HWComposer，HWC)。
在本申请实施例中，厂商框架层的第一相机服务模块、硬件抽象层和图像处理芯片之间形成通信控制通路，可以实现图像数据流从图像传感器输出后经硬件抽象层输入至第一相机服务模块，或者，实现数据流从图像处理芯片从输出后经硬件抽象层输入至第一相机服务模块。
在本申请实施例中，上述预览图像流可以是指在电子设备进行图像拍摄过程中，待发送至显示屏进行显示的图像数据。在应用层的应用程序需要相机预览服务的情况下，经应用框架层将预览图像流下发至显示硬件合成器，通过所述显示硬件合成器将预览图像流传出至图像处理芯片，进而通过图像处理芯片传输给显示设备进行预览显示。
该实施方式中，通过使所述厂商框架层包括第一相机服务模块和显示硬件合成器，这样，一方面可以基于所述厂商框架层通过所述硬件抽象层对所述图像处理芯片进行通信控制，另一方面，还可以基于所述厂商框架层将预览图像流传输给所述图像处理芯片。实现图像传感器和图像处理芯片与厂商框架层间的通信控制以及上层应用程序的预览需求通过厂商框架层传输至图像处理芯片。
请参见图1，所述图像处理系统还可以包括图像传感器、硬件层和内核层，所述内核层包括视频设备驱动(video for linux 2，V4L2)，所述硬件层包括图像传感器的端口CSI0，所述图像传感器的端口CSI0通过V4L2与相机硬件抽象模块连接。所述图像传感器可以依次通过所述端口CSI0和V4L2将图像传感器采集的图像数据流传递至相机硬件抽象模块。相机硬件抽象模块在接收到所述图像之后，可以将所述图像数据流传递至所述厂商框架层，所述厂商框架层可以将所接收到的图像数据流传递至图像处理芯片，以便于图像处理芯片对图像进行图像处理。此外，所述厂商框架层还可以将从图像处理芯片所接收到的图像数据流传输至应用框架层，以便于基于应用框架层对图像进行送显或存储。
可选地，所述硬件抽象层包括相机硬件抽象模块，所述第一相机服务模块通过所述显示硬件合成器与所述图像处理芯片连接，以形成第一数据传输通路；
可选地，所述图像处理芯片通过相机硬件抽象模块与所述第一相机服务模块连接，以形成第二数据传输通路。
上述相机硬件抽象模块可以为相机硬件抽象层(Camera Hardware Abstraction Layer，Camera HAL)。
请参见图1，所述内核层还包括显示直接渲染管理器驱动(Direct Rendering Manager Driver，DRM Driver)，所述第一相机服务模块依次通过显示硬件合成器、DRM Driver与所述图像处理芯片的端口DSI1连接，从而形成第一数据传输通路。所述图像处理芯片依次通过图像传感器的端口CSI1、内核层的V4L2、Camera Hal与第一相机服务模块连接，从而形成第二数据传输通路。
该实施方式中，通过形成上述第一数据传输通路，所述第一相机服务模块可以通过所述第一数据传输通路将待处理的图像数据流传输至图像处理芯片进行图像处理。相应地，通过形成上述第二数据传输通路，所述图像处理芯片可以通过第二数据传输通路将经过处理的图像处理传回至所述第一相机服务模块。
可选地，该系统还包括显示屏、存储器和应用层；
可选地，所述应用框架层包括第二相机服务模块、显示框架模块和媒体编解码器；
上述第二相机服务模块可以为谷歌相机服务(Google Camera Server)；上述显示框架模块可以为Surface Flinger，该Surface Flinger服务运行在Android框架的系统进程中，并负责管理Android系统的帧缓冲区(Frame Buffer)；上述媒体编解码器可以为媒体编码解码器(Media Codec)。
可选地，所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述图像处理芯片与所述显示屏连接，以形成第三数据传输通路；
在本申请实施例中，请参见图1，所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述DRM Driver、所述图像处理芯片、显示处理器(Display Processing Unit，DPU)与所述显示屏连接，以形成第三数据传输通路。
该实施方式中，通过形成上述第三数据传输通路，以便于所述第一相机服务模块通过所述第三数据传输通路将处理后的图像传输至显示屏进行预览显示。
可选地，所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器与所述存储器连接，以形成第四数据传输通路。
在本申请实施例中，请参见图1，所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器、开放多媒体加速模块(Open Media Acceleration，OMX)、数据块驱动模块(Block Driver)与存储器接口(UFS/sMMC)连接，以形成第四数据传输通路。
该实施方式中，通过形成所述第四数据传输通路，以便于所述第一相机服务模块通过所述第四数据传输通路将处理后的图像传输至存储器进行存储。
可选地，所述图像处理系统还包括应用层，所述应用框架层包括显示增强服务模块，所述厂商框架层还包括图像处理芯片硬件抽象模块，所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第一控制通路。
在本实施例中，上述显示增强服务模块可以为谷歌框架层的显示增加服务(Display Enhanced Service)，上述图像处理芯片硬件抽象模块可以为专用集成电路硬件抽象层(Application Specific Integrated Circuit Hardware Abstraction Layer，ASIC HAL)。
请参见图1，所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块、串行外设接口驱动(Serial Peripheral Interface Driver，SPI Driver)与图像处理芯片的SPI连接，以形成所述第一控制通路。
具体地，上述第一控制通路可以方便用于基于用户界面中的相应控件对图像处理芯片的状态进行控制。例如，可以在电子设备显示特定界面时，在显示界面中设置显示增强开关，用户可以根据需求打开或关闭所述显示增强开关，以方便用户提高所显示界面的画质。其中，所述特定界面具体可以是指游戏界面或者拍摄预览界面等。
可以理解的是，在所述图像处理芯片的显示增强功能启动的情况下，第一相机服务模块可以将需要传输至显示屏进行显示的图像先通过上述第一数据传输通路传输至图像处理芯片进行显示增强，图像处理芯片再通过第二数据传输通路将进行显示增强之后的图像传输至第一相机服务模块，第一相机服务模块再基于第三数据传输通路将显示增强之后的图像传输显示屏进行显示。
该实施方式中，通过形成上述第一控制通路，以便于用户通过用户界面中的控件对图像处理芯片的状态进行控制。
可选地，所述厂商框架层还包括图像处理芯片硬件抽象模块，所述第一相机服务模块通过所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第二控制通路。
请参见图1，所述第一相机服务模块可以依次通过所述图像处理芯片硬件抽象模块、SPI Driver与图像处理芯片的SPI连接，以形成所述第二控制通路。
该实施方式中，通过形成上述第二控制通路，以便于所述第一相机服务模块通过所述第二控制通路对所述图像处理芯片的状态进行控制。
在本申请实施例中，在图像处理芯片为显示增强模式的情况下，通过第一控制通路、第二控制通路通知图像处理芯片对预览图像流进行色彩增强。
在本申请实施例中，在录像结束的情况下，通过第一控制通路、第二控制通路通知图像处理芯片结束运行，从而节省电子设备的运行功耗。
请参见图2，图2是本申请实施例提供的一种图像处理方法的流程示意图，所述图像处理方法应用于上述实施例所述的图像处理系统，所述方法以下步骤包括：
步骤201、在厂商框架层接收到相机硬件抽象模块输出的第一图像数据流的情况下，控制所述厂商框架层将所述第一图像数据流传输至所述图像处理芯片；
步骤202、控制所述图像处理芯片对所述第一图像数据流进行图像处理，得到第二图 像数据流；
步骤203、控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层。
上述图像处理芯片对所述第一图像数据流进行图像处理具体可以是采用相关技术中常见的图像处理手段对第一图像数据流进行图像处理，例如，可以对所述第一图像数据流进行如下处理：去噪处理、清晰度调节处理和白平衡处理等。
在本申请实施例中，图像传感器将采集的第一图像数据流通过内核层传输至硬件抽象模块，然后通过硬件抽象模块传输至厂商框架层，然后控制所述厂商框架层将所述第一图像数据流通过内核层传输至所述图像处理芯片；控制所述图像处理芯片对所述第一图像数据流进行图像处理，得到第二图像数据流；再控制所述图像处理芯片将所述第二图像数据流通过内核层和硬件抽象层传输至所述厂商框架层。
在本申请实施例中，可以控制厂商框架层实现对图像传感器的输出数据、图像处理芯片的输入输出控制，实现将图像处理芯片的控制逻辑和数据通路可以通过厂商框架层控制。该实施方式中，由于本实施例提供的图像处理方法为与上述图像处理系统对应的图像处理方法，因此，所述图像处理方法具有上述图像处理系统的全部有益效果。
可选地，所述厂商框架层包括第一相机服务模块和显示硬件合成器，所述第一相机服务模块通过所述显示硬件合成器与所述图像处理芯片连接，以形成第一数据传输通路；
所述控制所述厂商框架层将所述第一图像数据流传输至所述图像处理芯片包括：
控制所述厂商框架层中的所述第一相机服务模块通过所述第一数据传输通路将所述第一图像数据流传输至所述图像处理芯片。
该实施方式中，通过形成上述第一数据传输通路，所述第一相机服务模块可以通过所述第一数据传输通路将第一图像数据流传输至图像处理芯片进行图像处理。
在本申请实施例中，结合图1，上述第一图像数据流可以是所述图像传感器采集的图像数据，且所述图像传感器可以依次通过端口CSI0和V4L2将所述第一图像数据流传递至Camera Hal。Camera Hal在接收到所述第一图像数据流可以将所述第一图像数据流传输至所述厂商框架层。所述厂商框架层通过DMR Driver和DSI1将该第一图像数据流传输至图像处理芯片。
可选地，所述图像处理芯片通过所述相机硬件抽象模块与所述第一相机服务模块连接，以形成第二数据传输通路；
所述控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层包括：
控制所述图像处理芯片通过所述第二数据传输通路将所述第二图像数据流传输至所述厂商框架层中的所述第一相机服务模块。
相应地，通过形成上述第二数据传输通路，所述图像处理芯片可以通过第二数据传输通路将第二图像数据流传回至所述第一相机服务模块。具体地，图像处理芯片将第二图像数据流经过CSI1、V4L2、Camera HAL输出至厂商框架层的vender Camera Server。
可选地，所述系统还包括显示屏、存储器和应用层，所述应用框架层包括第二相机服 务模块、显示框架模块和媒体编解码器。
可选地，所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述图像处理芯片与所述显示屏连接，以形成第三数据传输通路；
所述控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层之后，还包括：
控制所述第一相机服务模块通过所述第三数据传输通路将所述第二图像数据流传输至所述显示屏进行预览显示。
该实施方式中，控制第一相机服务模块基于第三数据传输通路将所述第二图像数据流传输至所述显示屏进行预览显示。具体地，第二图像数据流由厂商框架层的第一相机服务模块输出后通过应用框架层的第二相机服务模块后，通过应用层后输入至硬件框架层的显示框架模块，然后输出至厂商框架层的显示硬件合成器，通过内核层的显示直接渲染管理器驱动、DSI0后输入至图像处理芯片后再通过显示处理器后输入至显示屏显示，从而实现图像数据流的预览显示。
可选地，所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器与所述存储器连接，以形成第四数据传输通路；
所述控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层之后，还包括：
控制所述第一相机服务模块通过所述第四数据传输通路将所述第二图像数据流传输至所述存储器进行存储。
在该实施方式中，还可以控制第一相机服务模块基于第四数据传输通路将第二图像数据流传输至存储器存储。具体地，第二图像数据流由厂商框架层的第一相机服务模块输出后通过应用框架层的第二相机服务模块后，通过应用框架层的媒体解码器、硬件抽象层的开放多媒体加速模块及内核层的数据块驱动后，再通过UFS/sMMC输出至存储器中存储。从而同时实现对图像数据流的拍照或录像存储。
可选地，所述系统还包括应用层，所述应用框架层包括显示增强服务模块，所述厂商框架层还包括图像处理芯片硬件抽象模块；
所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第一控制通路；
所述方法还包括：
在接收到第一输入的情况下，控制所述应用层通过所述第一控制通路向所述图像处理芯片发送第一控制指令，所述第一控制指令用于控制所述图像处理芯片对图像数据流进行图像增强处理。
具体地，可以在电子设备显示特定界面时，在显示界面中设置显示增强开关，这样，用户可以根据需求打开或关闭所述显示增强开关，以方便用户提高所显示的界面的画质。 其中，所述第一输入可以是指用户在显示界面中打开所述显示增强开关的输入，该第一输入也可以为用户的语音输入。其中，所述特定界面可以为游戏界面或拍摄界面等。
可以理解的是，第一相机服务模块可以将需要传输至显示屏进行显示的图像先通过上述第一数据传输通路传输至图像处理芯片进行显示增强，图像处理芯片再通过第二数据传输通路将进行显示增强之后的图像数据流传输至第一相机服务模块，第一相机服务模块再基于第三数据传输通路将显示增强之后的图像数据流传输显示屏进行显示。
该实施方式中，通过形成上述第一控制通路，以便于用户通过电子设备所显示的用户界面对所述图像处理芯片的状态进行控制。
可选地，所述厂商框架层还包括第一相机服务模块和图像处理芯片硬件抽象模块；
所述第一相机服务模块通过所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第二控制通路；
所述方法还包括：
在所述系统处于录像数据流处理状态，且接收到录像结束输入的情况下，控制所述第一相机服务模块通过所述第二控制通路向所述图像处理芯片发送第二控制指令，所述第二控制指令用于控制所述图像处理芯片结束录像数据流处理。
可以理解的是，在所述电子设备接收到所述启动录像功能的启动输入时，可以基于所述第二图像数据流处理单元通过所述第二控制通路向所述图像处理芯片发送第三控制指令，其中，所述第三控制指令用于控制所述图像处理芯片开启。
上述第一相机服务模块中可以预先配置有上述触发第二控制指令和第三控制指令的控制逻辑。
上述录像结束输入和录像功能的启动输入可以是用户在电子设备所显示的应用界面中进行的输入。
该实施方式中，由于录像数据对于图像的质量通常较高，因此，在用户开始录像时，可以基于第三控制指令控制图像处理芯片开启，以便于对基于图像处理芯片对录像数据流进行图像增强，从而提高录像质量；相应地，当电子设备仅显示预览图像而无需录像时，则可以是不启动所述图像处理芯片，以节省电子设备的功耗。
如图3所示，本申请实施例还提供一种电子设备300，包括处理器301，存储器302，存储在存储器302上并可在所述处理器301上运行的程序或指令，该程序或指令被处理器301执行时实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，本申请实施例中的界面显示装置包括上述所述的移动电子设备和非移动电子设备。
应当理解，本申请涉及的处理器可以包括通用处理器、专用处理器等，例如包括中央处理单元(Central Processing Unit，CPU)、微处理器、数字信号处理器(Digital Signal Processor，DSP)、人工智能(Artificial Intelligent，AI)处理器、图形处理器(Graphics  Processing Unit，GPU)、专用集成电路(Application Specific Integrated Circuit，ASIC)、网络处理器(Network Processor，NP)、现场可编程门阵列(Field Programmable Gate Array，FPGA)或者其他可编程逻辑器件、门电路、晶体管、分立硬件组件等。
图4为实现本申请实施例的一种电子设备的硬件结构示意图。
该电子设备400包括但不限于：射频单元401、网络模块402、音频输出单元403、输入单元404、传感器405、显示单元406、用户输入单元407、接口单元408、存储器409、以及处理器410等部件。
其中，所述处理器410用于，在厂商框架层接收到相机硬件抽象模块输出的第一图像数据流的情况下，控制所述厂商框架层将所述第一图像数据流传输至所述图像处理芯片；
控制所述图像处理芯片对所述第一图像数据流进行图像处理，得到第二图像数据流；以及，
控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层。
可选地，所述厂商框架层包括第一相机服务模块和显示硬件合成器，所述第一相机服务模块通过所述显示硬件合成器与所述图像处理芯片连接，以形成第一数据传输通路；
可选地，所述图像处理芯片通过所述相机硬件抽象模块与所述第一相机服务模块连接，以形成第二数据传输通路；
可选地，所述处理器410具体用于，控制所述厂商框架层中的所述第一相机服务模块通过所述第一数据传输通路将所述第一图像数据流传输至所述图像处理芯片；
可选地，所述处理器410具体用于，控制所述图像处理芯片通过所述第二数据传输通路将所述第二图像数据流传输至所述厂商框架层中的所述第一相机服务模块。
可选地，还包括显示单元406、存储器409和应用层，所述应用框架层包括第二相机服务模块、显示框架模块和媒体编解码器；
可选地，所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述图像处理芯片与所述显示单元406连接，以形成第三数据传输通路；
可选地，所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器与所述存储器409连接，以形成第四数据传输通路；
可选地，所述处理器410还用于控制所述第一相机服务模块通过所述第三数据传输通路将所述第二图像数据流传输至所述显示单元406进行显示；
可选地，所述处理器410还用于控制所述第一相机服务模块通过所述第四数据传输通路将所述第二图像数据流传输至所述存储器409进行存储。
可选地，还包括应用层，所述应用框架层包括显示增强服务模块，所述厂商框架层还包括图像处理芯片硬件抽象模块；
可选地，所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第一控制通路；
可选地，所述处理器410还用于，在接收到第一输入的情况下，控制所述应用层通过所述第一控制通路向所述图像处理芯片发送第一控制指令，所述第一控制指令用于控制所述图像处理芯片对图像数据流进行图像增强处理。
可选地，所述厂商框架层还包括第一相机服务模块和图像处理芯片硬件抽象模块；
可选地，所述第一相机服务模块通过所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第二控制通路；
可选地，所述处理器410还用于，在所述系统处于录像数据流处理状态，且接收到录像结束输入的情况下，控制所述第一相机服务模块通过所述第二控制通路向所述图像处理芯片发送第二控制指令，所述第二控制指令用于控制所述图像处理芯片结束录像数据流处理。
本领域技术人员可以理解，电子设备400还可以包括给各个部件供电的电源(比如电池)，电源可以通过电源管理系统与处理器410逻辑相连，从而通过电源管理系统实现管理充电、放电、以及功耗管理等功能。图4中示出的电子设备结构并不构成对电子设备的限定，电子设备可以包括比图示更多或更少的部件，或者组合某些部件，或者不同的部件布置，在此不再赘述。
应理解的是，本申请实施例中，输入单元404可以包括图形处理器(Graphics Processing Unit，GPU)4041和麦克风4042，图形处理器4041对在视频捕获模式或图像捕获模式中由图像捕获装置(如摄像头)获得的静态图片或视频的图像数据进行处理。显示单元406可包括显示面板4061，可以采用液晶显示器、有机发光二极管等形式来配置显示面板4061。用户输入单元407包括触控面板4071以及其他输入设备4072中的至少一种。触控面板4071，也称为触摸屏。触控面板4071可包括触摸检测装置和触摸控制器两个部分。其他输入设备4072可以包括但不限于物理键盘、功能键(比如音量控制按键、开关按键等)、轨迹球、鼠标、操作杆，在此不再赘述。
存储器409可用于存储软件程序以及各种数据。存储器409可主要包括存储程序或指令的第一存储区和存储数据的第二存储区，其中，第一存储区可存储操作系统、至少一个功能所需的应用程序或指令(比如声音播放功能、图像播放功能等)等。此外，存储器409可以包括易失性存储器或非易失性存储器，或者，存储器409可以包括易失性和非易失性存储器两者。其中，非易失性存储器可以是只读存储器(Read-Only Memory，ROM)、可编程只读存储器(Programmable ROM，PROM)、可擦除可编程只读存储器(Erasable PROM，EPROM)、电可擦除可编程只读存储器(Electrically EPROM，EEPROM)或闪存。易失性存储器可以是随机存取存储器(Random Access Memory，RAM)，静态随机存取存储器(Static RAM，SRAM)、动态随机存取存储器(Dynamic RAM，DRAM)、同步动态随机存取存储器(Synchronous DRAM，SDRAM)、双倍数据速率同步动态随机存取存储器(Double Data Rate SDRAM，DDRSDRAM)、增强型同步动态随机存取存储器(Enhanced SDRAM，ESDRAM)、同步连接动态随机存取存储器(Synch link DRAM，SLDRAM)和直接内存总线随机存取存储 器(Direct Rambus RAM，DRRAM)。本申请实施例中的存储器409包括但不限于这些和任意其它适合类型的存储器。
处理器410可包括一个或多个处理单元；可选的，处理器410集成应用处理器和调制解调处理器，其中，应用处理器主要处理涉及操作系统、用户界面和应用程序等的操作，调制解调处理器主要处理无线通信信号，如基带处理器。可以理解的是，上述调制解调处理器也可以不集成到处理器410中。
本申请实施例还提供一种可读存储介质，所述可读存储介质上存储有程序或指令，该程序或指令被处理器执行时实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
其中，所述处理器为上述实施例中所述的电子设备中的处理器。所述可读存储介质，包括计算机可读存储介质，如计算机只读存储器ROM、随机存取存储器RAM、磁碟或者光盘等。
本申请实施例另提供了一种芯片，所述芯片包括处理器和通信接口，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
应理解，本申请实施例提到的芯片还可以称为系统级芯片、系统芯片、芯片系统或片上系统芯片等。
本申请实施例提供一种计算机程序产品，该程序产品被存储在存储介质中，该程序产品被至少一个处理器执行以实现如上述图像处理方法实施例的各个过程，且能达到相同的技术效果，为避免重复，这里不再赘述。
需要说明的是，在本文中，术语“包括”、“包含”或者其任何其他变体意在涵盖非排他性的包含，从而使得包括一系列要素的过程、方法、物品或者装置不仅包括那些要素，而且还包括没有明确列出的其他要素，或者是还包括为这种过程、方法、物品或者装置所固有的要素。在没有更多限制的情况下，由语句“包括一个……”限定的要素，并不排除在包括该要素的过程、方法、物品或者装置中还存在另外的相同要素。此外，需要指出的是，本申请实施方式中的方法和装置的范围不限按示出或讨论的顺序来执行功能，还可包括根据所涉及的功能按基本同时的方式或按相反的顺序来执行功能，例如，可以按不同于所描述的次序来执行所描述的方法，并且还可以添加、省去、或组合各种步骤。另外，参照某些示例所描述的特征可在其他示例中被组合。
通过以上的实施方式的描述，本领域的技术人员可以清楚地了解到上述实施例方法可借助软件加必需的通用硬件平台的方式来实现，当然也可以通过硬件，但很多情况下前者是更佳的实施方式。基于这样的理解，本申请的技术方案本质上或者说做出贡献的部分可以以计算机软件产品的形式体现出来，该计算机软件产品存储在一个存储介质(如ROM/RAM、磁碟、光盘)中，包括若干指令用以使得一台终端(可以是手机，计算机，服务器，或者网络设备等)执行本申请各个实施例所述的方法。
上面结合附图对本申请的实施例进行了描述，但是本申请并不局限于上述的具体实施方式，上述的具体实施方式仅仅是示意性的，而不是限制性的，本领域的普通技术人员在本申请的启示下，在不脱离本申请宗旨和权利要求所保护的范围情况下，还可做出很多形式，均属于本申请的保护之内。

Claims (16)

  1. 一种图像处理系统，其中，所述系统包括：
    图像处理芯片和硬件抽象层，所述图像处理芯片与所述硬件抽象层通信连接；
    厂商框架层和应用框架层，所述厂商框架层分别与所述硬件抽象层和所述应用框架层通信连接；
    所述厂商框架层还与所述图像处理芯片通信连接，所述厂商框架层用于对所述图像处理芯片进行通信控制。
  2. 根据权利要求1所述的系统，其中，所述厂商框架层包括第一相机服务模块和显示硬件合成器；
    所述第一相机服务模块用于通过所述硬件抽象层对所述图像处理芯片进行通信控制；
    所述显示硬件合成器用于在所述应用框架层的控制下，将预览图像流传输给所述图像处理芯片。
  3. 根据权利要求2所述的系统，其中，所述硬件抽象层包括相机硬件抽象模块，所述第一相机服务模块通过所述显示硬件合成器与所述图像处理芯片连接，以形成第一数据传输通路；
    所述图像处理芯片通过相机硬件抽象模块与所述第一相机服务模块连接，以形成第二数据传输通路。
  4. 根据权利要求3所述的系统，其中，还包括显示屏、存储器和应用层；
    所述应用框架层包括第二相机服务模块、显示框架模块和媒体编解码器；
    所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述图像处理芯片与所述显示屏连接，以形成第三数据传输通路；
    所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器与所述存储器连接，以形成第四数据传输通路。
  5. 根据权利要求2至4中任一项所述的系统，其中，还包括应用层，所述应用框架层包括显示增强服务模块，所述厂商框架层还包括图像处理芯片硬件抽象模块，所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第一控制通路。
  6. 根据权利要求2至5中任一项所述的系统，其中，所述厂商框架层还包括图像处理芯片硬件抽象模块，所述第一相机服务模块通过所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第二控制通路。
  7. 一种图像处理方法，其中，应用于权利要求1至6中任意一项所述的图像处理系统，所述方法包括：
    在厂商框架层接收到相机硬件抽象模块输出的第一图像数据流的情况下，控制所述厂 商框架层将所述第一图像数据流传输至所述图像处理芯片；
    控制所述图像处理芯片对所述第一图像数据流进行图像处理，得到第二图像数据流；以及，
    控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层。
  8. 根据权利要求7所述的方法，其中，所述厂商框架层包括第一相机服务模块和显示硬件合成器，所述第一相机服务模块通过所述显示硬件合成器与所述图像处理芯片连接，以形成第一数据传输通路；
    所述图像处理芯片通过所述相机硬件抽象模块与所述第一相机服务模块连接，以形成第二数据传输通路；
    所述控制所述厂商框架层将所述第一图像数据流传输至所述图像处理芯片包括：
    控制所述厂商框架层中的所述第一相机服务模块通过所述第一数据传输通路将所述第一图像数据流传输至所述图像处理芯片；
    所述控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层包括：
    控制所述图像处理芯片通过所述第二数据传输通路将所述第二图像数据流传输至所述厂商框架层中的所述第一相机服务模块。
  9. 根据权利要求8所述的方法，其中，所述系统还包括显示屏、存储器和应用层，所述应用框架层包括第二相机服务模块、显示框架模块和媒体编解码器；
    所述第一相机服务模块依次通过所述第二相机服务模块、所述应用层、所述显示框架模块、所述显示硬件合成器、所述图像处理芯片与所述显示屏连接，以形成第三数据传输通路；
    所述第一相机服务模块依次通过第二相机服务模块、所述媒体编解码器与所述存储器连接，以形成第四数据传输通路；
    所述控制所述图像处理芯片将所述第二图像数据流传输至所述厂商框架层之后，还包括：
    控制所述第一相机服务模块通过所述第三数据传输通路将所述第二图像数据流传输至所述显示屏进行预览显示，或，控制所述第一相机服务模块通过所述第四数据传输通路将所述第二图像数据流传输至所述存储器进行存储。
  10. 根据权利要求7至9中任一项所述的方法，其中，所述系统还包括应用层，所述应用框架层包括显示增强服务模块，所述厂商框架层还包括图像处理芯片硬件抽象模块；
    所述应用层依次通过所述显示增强服务模块、所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第一控制通路；
    所述方法还包括：
    在接收到第一输入的情况下，控制所述应用层通过所述第一控制通路向所述图像处理芯片发送第一控制指令，所述第一控制指令用于控制所述图像处理芯片对图像数据流进行图像增强处理。
  11. 根据权利要求7至10中任一项所述的方法，其中，所述厂商框架层还包括第一相机服务模块和图像处理芯片硬件抽象模块；
    所述第一相机服务模块通过所述图像处理芯片硬件抽象模块与所述图像处理芯片连接，以形成第二控制通路；
    所述方法还包括：
    在所述系统处于录像数据流处理状态，且接收到录像结束输入的情况下，控制所述第一相机服务模块通过所述第二控制通路向所述图像处理芯片发送第二控制指令，所述第二控制指令用于控制所述图像处理芯片结束录像数据流处理。
  12. 一种电子设备，其中，包括处理器和存储器，所述存储器存储可在所述处理器上运行的程序或指令，所述程序或指令被所述处理器执行时实现如权利要求7至11中任一项所述的图像处理方法的步骤。
  13. 一种可读存储介质，其中，所述可读存储介质上存储程序或指令，所述程序或指令被处理器执行时实现如权利要求7至11中任一项所述的图像处理方法的步骤。
  14. 一种芯片，其中，所述芯片包括处理器和通信接口，其中，所述通信接口和所述处理器耦合，所述处理器用于运行程序或指令，实现如权利要求7至11中任一项所述的图像处理方法的步骤。
  15. 一种计算机程序产品，其中，所述程序产品被至少一个处理器执行以实现如权利要求7至11中任一项所述的图像处理方法的步骤。
  16. 一种图像处理装置，其中，所述装置被配置成用于执行如权利要求7至11中任一项所述的图像处理方法的步骤。
PCT/CN2024/106853 2023-07-27 2024-07-22 图像处理系统、方法、电子设备、可读存储介质和芯片 Pending WO2025021079A1 (zh)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202310938352.0A CN116957906A (zh) 2023-07-27 2023-07-27 图像处理系统、方法、电子设备、可读存储介质和芯片
CN202310938352.0 2023-07-27

Publications (1)

Publication Number Publication Date
WO2025021079A1 true WO2025021079A1 (zh) 2025-01-30

Family

ID=88442396

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2024/106853 Pending WO2025021079A1 (zh) 2023-07-27 2024-07-22 图像处理系统、方法、电子设备、可读存储介质和芯片

Country Status (2)

Country Link
CN (1) CN116957906A (zh)
WO (1) WO2025021079A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116957906A (zh) * 2023-07-27 2023-10-27 维沃移动通信有限公司 图像处理系统、方法、电子设备、可读存储介质和芯片
TWI905565B (zh) * 2023-10-31 2025-11-21 英屬維爾京群島商威爾德嘉德有限公司 影像處理系統、影像處理方法、裝置及相關設備
CN119254912A (zh) * 2024-11-08 2025-01-03 维沃移动通信有限公司 视频录制方法、装置、电子设备及可读存储介质

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115883948A (zh) * 2021-09-28 2023-03-31 Oppo广东移动通信有限公司 一种图像处理架构、图像处理方法、设备及存储介质
CN116419049A (zh) * 2021-12-28 2023-07-11 维沃移动通信有限公司 图像处理方法、图像处理系统、装置和电子设备
CN116957906A (zh) * 2023-07-27 2023-10-27 维沃移动通信有限公司 图像处理系统、方法、电子设备、可读存储介质和芯片

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115883948A (zh) * 2021-09-28 2023-03-31 Oppo广东移动通信有限公司 一种图像处理架构、图像处理方法、设备及存储介质
CN116419049A (zh) * 2021-12-28 2023-07-11 维沃移动通信有限公司 图像处理方法、图像处理系统、装置和电子设备
CN116957906A (zh) * 2023-07-27 2023-10-27 维沃移动通信有限公司 图像处理系统、方法、电子设备、可读存储介质和芯片

Also Published As

Publication number Publication date
CN116957906A (zh) 2023-10-27

Similar Documents

Publication Publication Date Title
WO2025021079A1 (zh) 图像处理系统、方法、电子设备、可读存储介质和芯片
CN109101352B (zh) 图像处理算法架构、算法调用方法、装置、存储介质及移动终端
US20230418696A1 (en) Method for performing drawing operation by application and electronic device
CN110990075B (zh) 快应用的启动方法、装置、设备及存储介质
CN111625214B (zh) 音频控制方法、装置、设备及存储介质
CN110865863B (zh) 快应用的界面显示方法、装置及存储介质
CN101923479A (zh) 一种终端启动时控制屏幕显示的方法及移动终端
CN105468410B (zh) 系统升级方法及装置
CN110851240B (zh) 功能调用方法、装置及存储介质
CN104281478A (zh) 更新应用程序的方法及装置
CN111008057A (zh) 页面展示方法、装置及存储介质
CN110908629A (zh) 电子设备操作方法、装置、电子设备和存储介质
CN114285957A (zh) 图像处理电路及数据传输方法
WO2011001347A1 (en) A method, apparatus and computer program for creating software components for computing devices
CN110865864A (zh) 快应用的界面显示方法、装置、设备及存储介质
TWI597662B (zh) 電視系統中的儲存媒體及其應用程式管理方法
CN116302360A (zh) 中断处理方法、装置、电子设备及可读存储介质
CN113946370B (zh) 驱动系统及信息处理方法、设备、存储介质
CN114064129B (zh) 一种相机启动方法和装置、电子设备
WO2025015971A1 (zh) 用于多应用的非集成的单引擎后台渲染方法、系统以及设备
CN118885234A (zh) 一种播放应用启动动画的方法、电子设备及相关介质
CN116795557B (zh) 通信方法、电子设备及可读存储介质
KR20230086561A (ko) 경로 변경 소프트웨어가 탑재된 어플리케이션 및 이를 이용한 안드로이드 오디오 시스템의 오디오 스트림 출력 경로 변경 방법
CN114743513A (zh) 显示终端的矩阵背光控制方法、装置、显示终端及介质
CN108459858B (zh) 一种应用程序的功能调整方法、装置、设备及存储介质

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 24844770

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2024844770

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE